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Abstract — We consider the two-user interference channel with 
rate-limited feedback. Related prior works focus on the case 
where feedback links have infinite capacity, while no research 
has been done for the rate-Umited feedback problem. Several new 
challenges arise due to the capacity limitations of the feedback 
links, both in deriving inner-bounds and outer-bounds. We study 
this problem under three different interference models: the El 
Gamal-Costa deterministic model, the linear deterministic model, 
and the Gaussian model. For the first two models, we develop 
an achievable scheme that employs three techniques: Han- 
Kobayashi message splitting, quantize-and-binning, and decode- 
and-forward. We also derive new outer-bounds for all three 
models and we show the optimality of our scheme under the 
linear deterministic model. In the Gaussian case, we propose 
a transmission strategy that incorporates lattice codes, inspired 
by the ideas developed in the first two models. For symmetric 
channel gains, we prove that the gap between the achievable 
sum-rate of the proposed scheme and our new outer-bounds is 
bounded by a constant number of bits, independent of the channel 
gains. 

Index Terms — El Gamal-Costa deterministic model, Gaussian 
interference channel, linear deterministic model, rate-limited 
feedback, multi-user information theory. 



I. Introduction 

The history of feedback in communication systems traces 
back to Shannon. It is well-known that feedback does not 
increase the capacity of discrete memoryless point-to-point 
channels (T]. However, feedback can enlarge the capacity 
region of multi-user networks, even in the most basic case 
of the two-user memoryless multiple-access channel ||2l, |[3]. 
Hence, there has been a growing interest in developing feed- 
back strategies and understanding the fundamental limits of 
communication over multi-user networks with feedback, in 
particular the two-user interference channel (IC). See 0), Q, 
©, rTl, fSl], im, QOl for example. 

Especially in ||9l, the infinite-rate feedback capacity of the 
two-user Gaussian IC has been characterized to within a 2-bit 
gap. One consequence of this result is that interestingly feed- 
back can provide an unbounded capacity increase. This is in 
contrast to point-to-point and multiple-access channels where 
feedback provides no gain and bounded gain respectively. 

While the feedback links are assumed to have infinite 
capacity in |9|, a more realistic feedback model is one where 
feedback links are rate-limited. In this paper, we study the 
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impact of the rate-limited feedback in the context of the two- 
user IC. We focus on two fundamental questions: (1) what is 
the maximum capacity gain that can be obtained with access 
to feedback links at a specific rate of Cfb? (2) what are 
the transmission strategies that exploit the available feedback 
links efficiently? Specifically, we address these questions un- 
der three channel models: the El Gamal-Costa deterministic 
model ifTTI . the linear deterministic model of [121, and the 
Gaussian model. 

Under the El Gamal-Costa deterministic model, we derive 
inner-bounds and outer-bounds on the capacity region. As 
a result, we show that the capacity region can be enlarged 
using feedback by at most the amount of available feedback, 
i.e., "one bit of feedback is at most worth one bit of capac- 
ity". Our achievable scheme employs three techniques: (1) 
Han-Kobayashi message splitting; (2) quantize-and-binning; 
and (3) decode-and-forward. Unlike the infinite-rate feedback 
case |9|, in the rate-hmited feedback case, a receiver cannot 
provide its exact received signal to its corresponding trans- 
mitter; therefore, the main challenge is how to smartly decide 
what to send back through the available rate-limited feedback 
links. We overcome this challenge as follows. We first split 
each transmitter's message into three parts: the cooperative 
common, the non-cooperative common, and the private mes- 
sage. Next, each receiver quantizes its received signal and then 
generates a binning index so as to capture part of the other 
user's common message (that we call the cooperative common 
message) which causes interference to its own message. The 
receiver will then send back this binning index to its intended 
transmitter through the rate-limited feedback links. With this 
feedback, each transmitter decodes the other user's cooperative 
common message by exploiting its own message as side 
information. This way transmitters will be able to cooperate by 
means of the feedback links, thereby enhancing the achievable 
rates. This result will be described in Section HVl 

We then study the problem under the linear deterministic 
model [12 1 which captures the key properties of the wire- 
less channel, and thus provides insights that can lead to an 
approximate capacity of Gaussian networks ifTH . ||9l , ifTSl . 
lfT4ll . |[T5|. We show that our inner-bounds and outer-bounds 
match under this linear deterministic model, thus establishing 
the capacity region. While this model is a special case of 
the El Gamal-Costa model, it has a significant role to play 
in motivating a generic achievable scheme for the El Gamal- 
Costa model. Moreover, the explicit achievable scheme in this 
model provides a concrete guideline to the Gaussian case. We 
will explain this result in Section [V] 

Inspired by the results in the deterministic models, we 
develop an achievable scheme and also derive new outer- 
bounds for the Gaussian channel. In order to translate the 
main ideas in our achievabihty strategy for the deterministic 
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models into the Gaussian case, we employ lattice coding 
which enables receivers to decode superposition of codewords. 
Specifically at each transmitter, we employ lattice codes for 
cooperative messages. By appropriate power assignment of the 
codewords, we make the desired lattice codes arrive at the 
same power level, hence, receivers being able to decode the 
superposition of codewords. Each receiver will then decode the 
index of the lattice code corresponding to the superposition 
and sends it back to its corresponding transmitter where 
the cooperative common message of the other user will be 
decoded. For symmetric channel gains, we show that the gap 
between the achievable sum-rate and the outer-bounds can be 
bounded by a constant, independent of the channel gains. This 



will be explained in Section VI 

Related Work: Interference channels with infinite-rate 
feedback have received previous attention ID, ||5], ||6|, 0, IS, 
0, |10|. Kramer f4l, (5] developed a feedback strategy in the 
Gaussian IC; In |6|, Gastpar and Kramer established an outer- 
bound on the usefulness of noisy feedback for the two-user 
IC. Tandon and Ulukus in |7| derived an outer bound using 
the dependence balance bound technique |16|. However, the 
gap between the inner-bounds and the outer-bounds becomes 
arbitrarily large with the increase of signal to noise ratio (SNR) 
and interference to noise ratio (INR). Jiang-Xin-Garg |8| 
derived an achievable region in the discrete memoryless IC 
with feedback, based on block Markov encoding |17| and 
binning. However, no outer-bounds are provided. Suh and 
Tse in ||9l developed new inner bounds and outer bounds to 
characterize the feedback capacity of the Gaussian IC to within 
2 bits. Sahai et al. in 1 10|, have shown that in order to achieve 
the infinite-rate feedback capacity, it is sufficient to have only 
one feedback link of infinite rate from one receiver to either 
of the two transmitters. 

While no research has been done for the rate-limited feed- 
back problem, some works have been done for the different yet 
related problem - the conferencing encoder problem ifTSl . |fT9l , 
EQI, lEl, El, El- Tuninetti in CSl has proposed a coding 
strategy for the two-user IC that results in higher achievable 
rates by expoliting overheard information by the transmitters; 
backward decoding is incorporated at the receivers which 
we also employ in our achievability scheme. This result 
was improved in |fT9l by incorporating Gelfand-Pinsker cod- 
ing ll24l . 1251 to send cooperatively the private messages. 
Prabhakaran and Viswanath [21] have made a connection 
between the feedback problem and the conferencing encoder 
problem However, the connection is loose especially when the 
feedback link is rate-limited, although it can be strong for the 
infinite-rate feedback case. It turns out this distinction between 
the two problems leads to developing a new lattice-code-based 
achievable scheme in our problem. 

The rest of the paper is organized as follows. In Section [ll] 
we formulate our problem and give a brief overview of 



the channel models. In Section III we provide a motivating 
example which forms inspiration of our achievable scheme. 
In Section |IV[ we will provide our main results under the 
El Gamal-Costa deterministic model. We will then present 
the capacity theorem for the linear deterministic model in 
Section |V] Next, in Section |VI[ we describe our main results 



for the Gaussian channel. Section |VII| concludes the paper. 

II. Problem Formulation and Network Model 

We consider a two-user interference channel (IC) where 
a noiseless rate-limited feedback link is available from each 
receiver to its corresponding transmitter. See Figure [T] The 
feedback link from receiver k to transmitter k is assumed to 
have a capacity of Cfbio k = 1,2. on. 
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Fig. L Two-user interference cliannel with rate-limited feedback. 

Transmitters 1 and 2 wish to reliably communicate 
independent and uniformly distributed messages Wi G 
{1,2,..., 2^^!} and W2 G {1,2, . . . ,2^^^} to receivers 
1 and 2 respectively, during N uses of the channel. The 
transmitted signal of transmitter k, k — 1,2, at time i, 
1 < i < N, and the received signal of receiver fc, fc = 1, 2, at 
time i, 1 < i < N, are respectively denoted by X^^i and Yfc 
There are two feedback encoders at the receivers that create 
the feedback signals from the received signals: 

Yk,^ = SkAYk^,■■■,Yk,^-l)^ekAY^''^^), k ^ 1,2. (1) 

where we use shorthand notation to indicate the sequence up 
to « - 1. 

Due to the presence of feedback, the encoded signal Xk^i 
of user k at time « is a function of both its own message and 
previous outputs of the corresponding feedback encoder: 



(2) 



Each receiver fc, fc = 1,2, uses a decoding function dk.N 
to get the estimate Wk, from the channel outputs {Y/j ^ : i ~ 
1, . . . , N}. An error occurs whenever Wk 7^ Wk- The average 
probability of error is given by 



A 



k,N 



E[PiWk^Wk)], k = l,2, 



(3) 



where the expectation is taken with respect to the random 
choice of the transmitted messages Wi and W2. 

We say that a rate pair (i?i, R2) is achievable, if there exists 
a block encoder at each transmitter, a block encoder at each 
receiver that creates the feedback signals, and a block decoder 
at each receiver as described above, such that the average error 
probability of decoding the desired message at each receiver 
goes to zero as the block length N goes to infinity. The 
capacity region C is the closure of the set of the achievable 
rate pairs. 
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Fig. 2. The El Gamal-Costa detemiinistic IC with rate-Umited feedback. 

We will consider the following three channel models to 
investigate this problem. 

1- El Gamal-Costa Deterministic Interference Channel: 

Figure |2]illustrates the El Gamal-Costa deterministic IC ifTTI 
with rate-limited feedback. In this model the outputs Yi and Y2 
and the interferences Vi and V2 are (deterministic) functions 
of inputs Xi and X2 HlJ: 

Y2A = f2(X2A,ViA), 
Via = 9l{Xl,t), 

where .) and ,/2(-, •) are such that 

H{V2AYi,.,Xi^,)^0 

H{Vi^,\Y2^,,X2,^) = 

Here Vk is a part of Xk {k = 1, 2), visible to the unintended 
receiver This implies that in any system where each decoder 
can decode its message with arbitrary small error probability, 
Vi and V2 are completely determined at receivers 2 and 1, 
respectively, i.e., these are common signals. 

2- Linear Deterministic Interference Channel: 

This model, which was introduced in lfT2l . captures the 
effect of broadcast and superposition in wireless networks. We 
study this model to bridge from general deterministic networks 
into Gaussian networks. In this model, there is a non-negative 
integer n^j representing channel gain from transmitter k to 
receiver j, k = 1,2, and j = 1, 2. In the linear deterministic 
IC, we can write the channel input to the transmitter k at time 
I as Xk^^ = [Xl, Xl^...Xl^f e¥l k ^ 1,2, such that 
Xl j and X^ ^ represent the most and the least significant bits 
of the transmitted signal respectively. Also, q is the maximum 
of the channel gains in the network, i.e., q — max^j {rikj). 
At each time i, the received signals are given by 



where S is the qxq shift matrix and operations are performed 
in F2 (i.e., modulo two). See Figure [3]for an example. 

It is easy to see that this model also satisfies the conditions 
of (j5]l, hence it is a special class of the El Gamal-Costa 
detemiinistic IC. 
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Fig. 3. An example of a linear detemiinistic IC with rate-limited feedback, 
where nn = ?122 = 3, ni2 = 2, n2i = 1, and q = 3. 



3- Gaussian Interference Channel: 

In this model, there is a complex number hkj representing 
the channel from transmitter k to receiver j, k ~ 1,2, and 
j — 1,2. The received signals are 



— hiiXi^i + h2iX2A + Zi^i, 

Y2A = hi2Xi^i + h22X2A + Z2Si 



(7) 



where {Zj^i\]L^ is the additive white complex Gaussian noise 
process with zero mean and unit variance at receiver j, j — 
1, 2. Without loss of generality, we assume a power constraint 
of 1 at all nodes, i.e.. 



1 ^ 

-E(^|Xfe^,|2)<l k = l,2, 

i=l 



(8) 



where N is the block length. We will use the following 
notations: 



SNRi = |/in|2, SNR2 = |/i22p, 
INRi2 = |/ii2p, INR21 = |/i2ir 



III. Motivating Example 



(9) 



We start by analyzing a motivating example. Consider the 
linear deterministic IC with rate-limited feedback as depicted 
in Figure|4|a). As we will see in SectionjVj the capacity region 
of this network is given by the region shown in Figure Qb). 
Our goal in this section is to demonstrate how feedback 
can help increase the capacity. In particular, we describe 
the achievability strategy for one of the corner points, i.e., 
(i?i, R2) = (4, 1). From this example, we will make important 
observations that will later provide insights into the achievable 
scheme. 

The achievability strategy works as follows. In the first time 
slot, transmitter 1 sends four bits ai , . . . , 04 and transmitter 2 
sends only one bit 61 at the third level, see Figure |4|a). This 
way receiver 1 can decode its intended four bits interference 
free, while receiver 2 has access to only ai hi and 02. In 
the second time slot, through the feedback link, receiver 2 
feeds fli ® hi back to transmitter 2 who can remove hi from it 
to decode ai. Also during the second time slot, transmitter 1 
sends four fresh bits 05, . . . , ag, whereas transmitter 2 sends 
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Fig. 4. (a) A two-user linear deterministic IC with channel gains nn = 
1^22 = 4, ni2 = n2i = 2 and feedback rates Cfbi = C'fb2 = 1. i^nd (b) 
its capacity region. 



one new bit 62. In the third time slot, through the feedback 
link, receiver 2 feeds 62 © ^5 back to transmitter 2 who can 
remove 62 from it to decode 05. Moreover, during the third 
time slot, transmitter 1 sends four new bits ag, . . . , ai2, while 
transmitter 2 sends one new bit 63 and at the level shown in 
Figure |4| a), sends the other user's information bit ai decoded 
in the second time slot with the help of feedback. With this 
strategy receiver 2 has now access to ai and can use it to 
decode bi. Note that receiver 1 already knows ai and hence 
can decode ai2- This procedure will be repeated over the next 
time slots. During the last two time slots, only transmitter 
2 sends the other user's information decoded before, while 
transmitter 1 sends nothing. Therefore, after B time slots, we 
achieve a rate of (i?i,i?2) = "^^§^(4, 1), which converges to 
(4, 1) as B goes to infinity. 

Based on this simple capacity-achieving strategy, we can 
now make several observations: 

• The messages coming from transmitter 1 can be split into 
three parts: (1) "cooperative common": this message is visible 
to both receivers, while interfering with the other user's signals 
(e.g., ai at transmitter 1 in the first time slot). This should 
be fed back to the transmitter so that it can be used later in 
refining the desired signals corrupted by the interfering signal; 
(2) "non-cooperative common": this message is visible to both 



receivers, however it does not cause any interference (e.g., 
02 at transmitter 1 in the first time slot); (3) "private": this 
message is visible only to the intended receiver (e.g., 03 and 
04 at transmitter 1 in the first time sot). Denote these messages 
by Wkcc, Wknc, and Wkp, respectively, where fc = 1,2 is the 
transmitter index. 

• To refine the desired signal corrupted by the cooperative 
common signal of transmitter 1 (i.e., ai), receiver 2 utilizes the 
feedback link to send the interfered signal [i.e., oi 61) back 
to transmitter 2. Transmitter 2 then employs a partial decode- 
and-forward to help receiver 1 decode its messages, i.e., the 
cooperative message of transmitter 1 is decoded at transmitter 
2 and it will be forwarded to receiver 2 during another time 
slot. 

• As we can see in this example, encoding operations 
at each time slot depend on previous operations, thereby 
motivating us to employ block Markov encoding. As for the 
decoding, we implement backward decoding at receivers. Each 
receiver waits until the last time B and we use the last received 
signal to decode the message received at time B — 2. We then 
decode the message received at time B — 3 and all the way 
down to the message received at time 1. 

These observations will form the basis for our achievable 
schemes in the following sections. 

IV. Deterministic Interference Channel 

In this section, we consider the El Gamal-Costa determinis- 
tic IC with rate-limited feedback, described in Section |ll] The 
motivating example in the previous section leads us to develop 
a generic achievable scheme based on three ideas: (1) Han- 
Kobayashi message splitting ll26l ; (2) quantize-and-binning; 
and (3) decode-and-forward ifTTl . As mentioned earlier, we 
split the message into three parts: the cooperative common 
message; non-cooperative common message; and private mes- 
sage. We employ quantize-and-binning to feed back part of the 
interfered signals through the rate-limited feedback link. With 
feedback, each transmitter decodes part of the other user's 
common information (cooperative common) that interfered 
with its desired signals. We accomplish this by using the 
partial decode-and-forward scheme. We also derive a new 
outer bound based on the genie-aided argument ifTTI and the 
dependence-balance -bound technique 1.27 J . 1.281 . Q. 

A. Achievable Rate Region 

Theorem 1: The capacity region of the El Gamal-Costa 
deterministic IC with rate-limited feedback includes the set 



TZ of (i?i,i?2) satisfying inequalities (lOaHlOmi. 

Proof: We first provide an outline of our achievable 
scheme. We employ block Markov encoding with a total 
size B of blocks. In block 1, transmitter 1 splits its own 
message into cooperative common, non-cooperative common 
and private parts and then sends a codeword superimposing 
all of these messages. The cooperative common message is 



The non-cooperative common 

N.{1) 



sent via the codeword it^'*^^-* 

message is added to this, being sent via v"''"^' . The private 
message is then superimposed on top of the previous messages, 
being sent via xf^'*^^'. Similarly, transmitter 2 sends x^''^''. In 
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Fi?2 


< 
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h/(Xi,F2;Yi|C/,Vi,C/2) 



(10a) 
(10b) 
(10c) 
(lOd) 
(lOe) 
(lOf) 

(lOg) 

(lOh) 

(lOi) 

2R1 + R2 < I{U,V2,Xi;Yi)+I{Xi;Yi\U,Vi,V2)+I{X2,Vi;Y2\U,Ui,V2) (lOj) 

+ min(/([/i;r2|[/,X2),CFB2-<52) 
2i?i + i?2 < 2 min(/(C/i ; ^2 1 C/, ^2) , Cfb2 - ^2 ) + min(/({/2 ■,Yi\U, X,),CfBi - Si) + I{Xi,V2;Yi\ U, L/i , C/2 ) 

nlf/, ^1, V2) + I(X2, Vi;Y2\U, C/i, F2) (10k) 
R1+2R2 < I{U,Vi,X2;Y2) + I{X2;Y2\U,V2,Vi) + I{Xi,V2;Yi\U,U2,Vi) (101) 

+ min(/(C/2;yi|C/,Xi),CFBi-<5i) 
Ri +2R2 < 2 min(/([/2 ; Fi | C/, ) , Cfbi - ) + min(/(C/i ; ^2 1 C/, ^2) , Cfb2 - S2) + I{X2,Vi;Y2\U,Ui,U2) 

+I{X2; Y2\U, Vu V2) + I{Xi, V2; Yi\U, C/2, Fi) (10m) 

over all joint distributions 

piu)p{ui\u)p{u2\u)p{vi\u,ui)p{v2\u,U2)pixi\u,ui,vi)p{x2\u,U2,V2)p{yi\yi)piy^^ 

where 

Si= I{Yi;Yi\U,U2,Xi), 
52^I{Y2;Y2\U,UuX2). 



block 2, receiver 1 quantizes its received signal into 
yf''-^'' with the rate of Ri. Next it generates a bin index 
by considering the capacity of its feedback link and then 
feeds the bin index back to its corresponding transmitter 
Similarly, receiver 2 feeds back the corresponding bin index. 
In block 3, with feedback, each transmitter decodes the other 
user's cooperative common message (sent in block 1) that 
interfered with its desired signals. The following messages 
are then available at the transmitter: (1) its own message; and 
(2) the other user's cooperative common message decoded 
with the help of feedback. Using its own cooperative com- 
mon message as well as the other user's counterpart, each 
transmitter generates the codeword u^'^-^K This captures the 
correlation between the two transmitters that might induce the 
cooperative gain. Conditioned on these previous cooperative 
common messages, each transmitter generates new cooperative 
common, non-cooperative common, and private messages. It 
then sends the corresponding codeword. This procedure is 
repeated until block B — 2. In the last two blocks B — 1 and 
B, to facilitate backward decoding, each transmitter sends the 
predetermined common messages and a new private message. 
Each receiver waits until total B blocks have been received 



and then performs backward decoding. 

Codebook Generation: Fix a joint distribution 

p{u)p{ui \u)p{u2\u)p{xi\ui , u)p{x2\u2 , u)p{yi\yi )p{y2\y2)- 
We will first show that p{xi\u,ui,vi) and p{x2\u,U2,V2) are 
functions of the above distributions. To see this, let us write 
a joint distribution p{u, ui, U2, Vi,V2,Xi, X2) in two different 
ways: 

p{u,Ui,U2,Vi,V2,Xi,X2) 

= p{u)p{ui\u)p{u2\u)p{xi\u,ui)p{x2\u,U2)S{vi - gi{xi)) 

X S{V2 - 92{X2)) 
= p{u)p{ui\u)p{u2\u)p{vi\u, Ui)p{v2\u, U2)p{xi\u, Ui,Vi) 
X p{x2\u,U2,V2), 

(11) 

where 5{-) indicates the Kronecker delta function. No- 
tice that by the El Gamal-Costa model assumption Q, 

p{vi\u,ui,xi) = S{vi-gi{xi)) andp{v2\u,U2,X2) = S{v2- 
52 (2:2)) ■ From this, we can easily see that 

I . p{xi\u,ui)S{vi - gi{xi)) 

p{xi\u,ui,vi) = — ^ , 

p{vi\u,ui) 
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/ I N P{X2\U,U2)S{V2- 92{xi)) 

P[X2\U,U2,V2) = z , ^ . (12) 

P[V2\U, U2) 

We now generate codewords as follows. Transmitter 1 
generates 2^'^^^'''^^^'"''> independent codewords u^{i,j) 
according to niLiPl""*!^ where i e {1, • • • ,2^^^'='=} 
and j e {1, • • • ,2^^='"}. For each codeword 



r e [1 : 2^C'fbi], 

Now the idea is to feed back the bin index r such 
that q G I3{r). This helps transmitter 1 to decode the 



u^{i,j), it generates 2^«-^ independent codewords quantized signal y^'^''\ Specifically, using the bin index r, 
accordmg to U,=,p{uuK)^ where k e transmitter 1 finds a unique index q e 6(r) such that 



{I,-- - ,2^^^'^'^}. Subsequently, for each pair of codewords 
[u^{i,j),u^{{i,j),k)), generate 2^^!'"= independent 
codewords v^{{ij),kj) according to Y\fL^p{vii\ui,ui,) 
where I e {I, - - ,2^^^"'=}. Lastly, for each triple of 
codewords (u'^ {i,j),u'^ {{i,j),k),vf {{i,j),k,l)), generate 
2NRip independent codewords x'^' {{i, j), k,l,m) according 
to Yl^=iP{xii\ui,uii,vii) where m € {1, • ' • ,2^^!"}. On 
the other hand, receiver 1 generates 2^^^ sequences (q) 
according to Yl^^iP{yii) where q e {1, • • • , 2^^i }. In 
the feedback strategy (to be described shortly), we will see 
how this codebook generation leads to the joint distribution 
p{yi\yi)- Similarly, receiver 2 generates y^. 

As it will be clarified later, for a given block b, indices i and 
j in u^{i,j) correspond to the cooperative common message 
of transmitter 1 and transmitter 2 sent during block {b — 2) 
respectively. Then YiiLi Pi'^nl'^i) ussd to create 2^^^^" 
independent codewords corresponding to the cooperative com- 
mon message of transmitter 1 in {I,-- - ,2^^^'^'^}. Simi- 
larly, 2^^'^"" independent codewords are created according 
to YliLiPi^iiWiiUii)^ corresponding to the non-cooperative 
common message of transmitter 1 in {1, • • • , 2^^^^""}. Finally, 
YliLiP{xii\ui,uii,vii) is used to create 2^^^p independent 
codewords corresponding to the private message of transmitter 
1 in {I,-- - ,2'^^^"}. 

Notation: Notations are independently used only for this 
section. The index k indicates the cooperative common mes- 
sage of user 1 instead of user index. The index i is used for 
both purposes: (1) indicating the previous cooperative common 
message of user 1; (2) indicating time index. It could be easily 
differentiated from contexts. 

Feedback Strategy (Quantize-and-Binning): Focus on the 
6-th transmission block. First receiver 1 quantizes its received 
signal y^'''''^ into with the rate of R. Next it finds 



an index q such that (jj^ 



JV,(b+l) 



G Tt^\ where 



q e [1 : 2 and Te indicates a jointly typical set. The 
quantization rate Ri is chosen so as to ensure the existence of 
such an index with probability 1 . The covering lemma in ||29| 
guides us to choose Ri such that 



Ri>I{Yi;Yi), 



(13) 



since under the above constraint, the probability that there 
is no such an index becomes arbitrarily small as goes 
to infinity. Notice that with this choice of the codebook 
yf{q) according to YiiLiPiVn) would match the codeword 
according to n^iP(yHlyH)- 

We then partition the set of indices q e [1 : 2^^^] into the 
number 2'^'-^'''^^ of equal-size subsets (that we call bins): 



( 



e T}'''. Notice that by the 
the decoding error probability goes 



packing lemma in 
to zero if 



Ri-CfBi<I{Yi;X,,U). 



(14) 



Using (13 1 and (14 1, transmitter 1 can now decode the quan- 
tized signal as long as 

<Cfbi, (15) 
Similarly, transmitter 2 can decode y^''"''^^'' (9) if 

IiY2;Y2\X2,U)<CFB2- (16) 

Encoding: Given yf^'^'' (decoded with the help of feed- 



back), transmitter 1 finds a unique index 



(6-2) 



k (sent 



from transmitter 2 in the (6 — 2)-th block) such that 



where 



,(•) 



(b-4) ^;,(6-4) 



Wo 



indicates 

(6-2) (6-2) 



the known messages 
). Notice that due to the 



feedback delay, the fed back signal contains information of 
the (6 — 2)-th block. We assume that ^2^^'' correctly 
decoded from the previous block. By the packing lemma |29|, 
the decoding error probability becomes arbitrarily small (as 
N goes to infinity) if 

R2cc<I{U2;Yi\Xi,U) 

= /(fi ; Fi I C/, Ai ) - /(Fi ; Fi I [/, (72 , ) 

< min(CFBi -<5i,/(C/2;ri|Xi,C/)), (17) 

where the last inequality follows from ( [T5| , Si := 

I{Yi;Yi\U,U2,Xi)_md I{U2;Yi\Xi,U) < /([/2; ^ [/). 

Based on {'w^icc^\w'^^^'^^), transmitter 1 generates a 
new cooperative-common message wf'^^, a non-cooperative- 



common message wj^'^ and a private message w\"p . It then 
sends . Similarly transmitter 2 decodes 'w'"i~'^\ generates 
(«^2cL^«2nc>w'2p) and then sends x^ . 

Decoding: Each receiver waits until total B blocks have been 
received and then does backward decoding. Notice that a block 
index b starts from the last B and ends to 1. For block b, 
receiver 1 finds the unique indices k, I) such that for some 

TO e [1 : 2^^^-] 



(fc) 



,fc,0,ur((^,j)>(t)),.2^((z\j)>(ti,TO),yf-(^)) erw, 



where we assumed that a pair of messages (wl 



cci ^2cc 



was successively decoded from the future blocks. Similarly 



'with a slight abuse of notation, we use the same index i to represent time. receiver 2 decodes [wl 



(b-2) .,(6-2) .(h) 



, W. 



2cc 



1 ^2nc^ ^2p 
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Analysis of Probability of Error: By symmetry, we con- 
sider the probability of error only for block b and for 
a pair of transmitter 1 and receiver 1. We assume that 
iwi~^\w!2~^\w[''^^,wfj) ^ (1,1,1,1) was sent through 
the blocks; and there was no backward decoding error from 
the future blocks, i.e., {wf]^,W2cc) are successfully decoded. 
Define an event: 



E^jHm = {(u^(^,J^<((^,J),^&f2),«f ((z,j),4cU) 



Let -Efiiinj be the complement of the set Emim- Then, by 
AEP, Pi'{Efiii^^) — > as goes to infinity. Hence, we focus 
only on the following error event. 



Pr U 

klm 

^(ij-,fe, 0^(1,1,1,1),™ 

(i,j)#(l,l) \k,Um 



=Pi-(Bl 



^Pr(|JSnfc;i) + Pr ( U ^n^''" ) 

V ' V ■ 

=Pi-(B2) =Pr(£:3) 

^Pr(i;nin)+ Pr(^iiiim)- 



(18) 



=Pr(B4) 



=Pi-(B5 



Here we have: 



Hence, the probability of error can be made arbitrarily small 

if 

f i?2cc < min(/(C/2;yi|C/,Xi),CFBi -<5i) 
i?ip</(Ai;yi|C/, 1^1,^2) 

Rip + i?2„c < /(Ai , 1^2 ; (7, , C/2) 

i?ip + i?i„c</(Ai;Yi|;7,C/i,F2) 

i?lp + Rxnc + i?2„c < /(Ai , ^2 ; l"l I [/, (7i , C/2 ) 
i?lp + i?icc + R2CC + -Rlnc + ^2nc < ^(C^, ^2, Ai; Yi), 

(19) 

f i?iec < min(/(i7i;y2|C/,A2),CFB2 -<52) 

i?2p</(^2;1^2|C/,V^l,V^2) 
i?2p + Rl-nc < /(A2, Fi; r2|C/, V2, Ui) 
R2p + R2nc<I{X2;Y2\U,U2,Vi) 
R2p + R2nc + Rluc < /(A2, Vi;Y2\U, (Ji, C/2) 
-R2p + -R2CC + Rice + Rlnc + R2nc < I{U, Vi,X2;Y2). 

(20) 

Employing Fourier-Motzkin-Elimination, we finally get the 
bounds of ( |10a[ )-( fT0m| l. ■ 

Remark 1 ( Connection to Related Work MS'i . The 
three-fold message splitting in our achievable scheme is a 
special case of the more-than-three-fold message splitting 
introduced in ifTSl . lISTI . Also our scheme has similarity 
to the schemes in fTS^, f2T| in a sense that the three 
techniques (message-splitting, block Markov encoding and 
backward decoding) are jointly employed. However, due to 
a fundamental difference between our rate-limited feedback 
problem and the conferencing encoder problem in [181, [21 1, 
a new scheme is required for feedback strategy and this 
is reflected as the quantize-and-binning scheme in the El 
Gamal-Costa deterministic model. It turns out this distinction 
leads to a new lattice-code-based scheme in the Gaussian 
case, as will be explained in Section VI. 



B. Outer-bound 

Theorem 2: The capacity region of the two-user El Gamal- 
Costa deterministic IC with rate limited feedback (as described 
in Section [njl is included by the set C of (i?i, R2) such that 



Pr(£^i) < 24 




Ri 


< 


mm{H{Yi),H{Yi\Vi,V2,Ui) 


(21a) 


^ 2N(B,lac + R2cc+Rl^c + R2^a + Rlv-I(U,Xi,Vr,Yl)+5f-) 






+ 


H{Y2\X2,Ui)} 




Vx{E2) < 2 X 2^(-'^i"-+-^ip"-^(^i''*'il'^''^i'"'^2)+2£) 




Ri 


< 


H{Yi\X2,Ui) + CfB2 


(21b) 


Pr(i?3) < 2 X 2^(-'^i"<^+-'^2"=+-'^iP"-'^(^i'^2:Vi|C/,C/i,;72)+3e) 




R2 


< 


mm{H{Y2),H{Y2\Vi,V2,U2) 


(21c) 


Pr(£;4) < 2^(^if--f(^i''*'il'^'"^i'"^2)+e) 






+ 


H(Yi\Xi,U2)} 




^r{E^) < 2^(-R2nc+flip-/(Xi,y2;yi|c/,yi,(72)+2e)_ 




R2 


< 


H(Y2\Xi,U2)+CfBl 


(21d) 


Ri 


+ i?2 


< 


H(Yi\Vi,V2,Ui)+H{Y2) 


(21e) 


Notice in Pr(£'i) that as long as (j, j) 7^ (1, 1), all of the cases 


Ri 


+ R2 


< 


H(Y2\Vi,V2,U2)+H{Y,) 


(21f) 


(decided depending on whether or not fc 7^ 1, / 7^ 1 and m 7^ 


Ri 


+ i?2 


< 


H{Yi\Vi)+H{Y2\V2) 


(21g) 


1) are dominated by the worst case bound that occurs when 






+ 


CfbI + Cfb2 




fc 7^ 1, i 7^ 1 and m 7^ 1. Since (i, j) 7^ (1, 1) covers three 




+ R2 


< 


H{Y,) + H{Y,\Vi,V2,Ui) 


(21h) 


different cases and we have eight different cases depending on 
the values of (fc, I, m), we have 24 cases in total. This number 






+ 


H(Y2\V2) + CfB2 




reflects the constant 24 in the above first inequality. Similarly, 


Ri -f- 


2i?2 


< 


H(Y2)+H{Y2\Vi,V2,U2) 


(21i) 


we get the other four inequalities as above. 






+ 


H(Yi\Vi) + CfBi, 
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for joint distributions p{ui,U2)p{xi\ui,U2)p{x2\ui,U2)- As 
depicted in Figure |2] Cfbi and Cfb2 indicate the capacity of 
each feedback Hnk. 

Remark 2: In the non-feedback case, i.e., Cfbi = C'fb2 — 
0, by setting Ui = U2 = 0, we recover the outer-bounds 
of Theorem 1 in [|TT|. Note that in this case, H{Yi\X2) = 
H{Yi\V2) and H{Y2\Xi) = H{Y2\Vi). In fact, our achievable 
region of Theorem [T] matches the outer-bound under this 
model, thereby achieving the non-feedback capacity region. 

Remark 3 (Feedback gain under symmetric feedback cost): 
Notice from (21gi that the sum-rate capacity can be at most 
increased by the rate of available feedback, i.e., one bit of 
feedback provides a capacity increase of at most one bit. 
Therefore, if the cost of using the feedback link is the same 
as that of using the forward link, there is no feedback gain 
under the feedback cost. However, it turns out that there is 
indeed feedback gain when the costs are asymmetric. This 
will be discussed in more details in Remark |5] of Section [V] 
Proof: By symmetry, it suffices to prove the bounds 
of (|2Tal), (|2Tb]), ([jle]), dJTgl), and (|2Th|. The bounds of ( 



and ( 21b| i are nothing but the cutset bounds (see Appendix |A 
for details). Also ( |21e| l is the bound when the feedback link 
has infinite capacity 1*91. Hence, proving the bounds of (21g 



and (21hi is the main focus of the proof. We will present the 
proof of (21gi here and for completeness, the proof for all 



other bounds is provided in Appendix |^ 
Proof of ( |21g) : 

R2 - eN) < HWi;Yf 



NiRi 



H(Y,^) 
= H{Yi) 



-H{Yl'\W,)+H{Y^')- 

-HiV,''\W2)+HiY2'') 
-[H{V,'')-I{V,'';W2)] 



H{Y2''\W2) 



W2 



H{Yi\V2'')-H{Vi 



I{Vf; W2) + I{V^:. Wi) + H{Yl'\Vl') + H{Y. 



N\'irN 



< 



/(T/i^, W^i, fi^; W2) + 7(^2^, T4^2, ^3^; Wi) 
H{Y,''\Vl')+H{Yi'\V2'') 



id) 



H{Y2''\V2'') 



Yr;W2) 

W2\Wi) - 



IiW2,Y^';W^)+HiY,^\V,^) 



I{Y2'';Wi\W2) 



Claim 1: H{Y^\Wi) = H{Vf\Wi) and H{Yi^\W2) = 
H{V,^\W2). 

Proof By symmetry, it suffices to prove the first one. 

^i'5]i/(\^2.irr\w^i,^i,^2"') 

where (a) follows from the fact that Yu is a function of 
{Xii,V2i) and Xu is a function of (VKi,y/"^); (&) follows 
from the fact that XI is a function of [Wi^Y^-^) and V^^^ 
is a function of (Y]*^\X{^^); (c) follows from the fact that 



H{Yi 



N\ 



Wi)+H{Yi^\W2)+H{Y{ 



N\'srN 



1/(^2^1 



ie) ^ 



CfB2) + 5] i^(nd^H) + 51 ^(^2d^^2.), 

where (a) follows from H{Y-^^\Wi) = H{V2^\Wi) and 
i7(l2^|H/2) = H{Vf\W2) (see Claim [l] below); (b) follows 
from providing and V^^ to receiver 1 and 2, respectively; 
(c) follows from the fact that adding information increases 
mutual information; (d) follows from the fact that Vj^ is 
a function of {Wk,Y^~^); (e) follows from the fact that 
H{Yi^\Wk) < NCfBk and conditioning reduces entropy. 



Yl~ is a function of {Xl^ ,¥2^ ) and XI is a function of 
{Wi, V^-^) (see Claim H below). ■ 
Claim 2: For i > 1, is a function of (W^i,K,*"^)- 
Similarly, X^ is a function of (1^2, VY"^). 

Proof: By symmetry, it is enough to prove the first 
one. Since the channel is deterministic, XI is a function of 
(Wi,VF2)- In Figure |2] we see that information of W2 to 
the first link pair must pass through V2i. Also note that Xu 
depends on the past output sequences until i — 1. Therefore, 
X{ is a function of (1^1,^2'"^)- ■ 



V. Linear Deterministic Interference Channel 

In this section, we consider the linear deterministic IC with 
rate-limited feedback described in Section |ll] Since this model 
is a special case of the El Gamal-Costa model, our inner 
and outer bounds derived in the previous section also apply 
to this model. We show that the inner-bound and the outer 
bound derived in Theorem[T]and[2]respectively, coincide under 
this linear deterministic model, thus establishing the capacity 
region. 

Theorem 3: The capacity region of the linear determinis- 
tic IC with rate-limited feedback is the set of non-negative 
(i?i,i?2) satisfying 

Ri < mill {max(nii, 7221), max(nii, 71-12)} (22a) 

Ri < nn + CpBi (22b) 

R2 < miii{max(n22,«i2),max(n22,r7.2i)} (22c) 

R2 < ri22 + CFBl (22d) 

Ri+ R2 < (nil - ni2)^ + max(n22,fii2) (22e) 

R1+R2 < (^22 - ^21)^ + max(nii,n2i) (22f) 

R1+R2 < max{n2i, (»^ii - ?ii2)^} (22g) 

+ max {ni2, (^22 - ^21)^} + Cfbi + C'fb2 

2R1+R2 < (rill - ni2)+ + max(nii,n2i) (22h) 

+ max{ni2, (^22 - '^21)^} + Cfb2 

i?i + 2i?2 < ("-22 - »^2i)^ + max(n22, ^12) (22i) 

+ max {^21, (nil - ni2)+} + Cfbi- 

Remark 4: In the non-feedback case, i.e., Cfbi = Cfb2 ~ 
0, this theorem recovers the result of ifTTl . llT3l . In the infinite 
feedback case, i.e., Cfbi = Cfb2 = 00, this recovers the 
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result of ll30l . |l9l. Considering the sum-rate capacity under 
symmetric setting, i.e., nn — n22 = n, ni2 — 7121 — m, 
Cfbi ~ Cfb2, this recovers the resuh of ^T\]. 

Proof: The converse proof is trivial due to Theorem |2] 
For achievability, we will use the result in Theorem [T] By 
choosing the following input distribution, we will show the 
tightness of the outer bound. Vfc G {1,2} and j 7^ k, we 
choose 



U = 0, 

Uk^U® Xkcc, 

Vk — Uk® Xknc, 

Xk ~ Vk® Xkp, 

Yk = LSBmin(«fcj,CFBj)(^fe); 



(23) 



where for any column vector A, LSB„(A) takes the bottom 
n (n < \A\) entries of A while returning zeros for the 
remaining part; and Xkcc, Xknc, and Xkp are independent 
random vectors of size max{nkk,nkj}, such that 

• The random vector Xkp consists of {ukk — "-fcj)^ i-i-d. 
Ber (i) random variables at the bottom, denoted by * in 
( [24| , corresponding to the number of private signal levels 
of transmitter k. 

• The random vector Xkcc consists of {ukk — ^kj)^ i-i-d. 
Ber (i) random variables in the middle (above the private 
signal levels), denoted by * in (24i, corresponding to 



the number of common signal levels that will be re-sent 
cooperatively through the other commuication link with 
the help of feedback- 

The random vector Xknc consists of (ukj — Cfbj)^ i-i-d- 
Ber (i) random variables at the top, denoted by * in (24i, 



corresponding to the number of non-cooperative common 
signal levels. 

As we show in Appendix |B] with this choice of random 
variables, the achievable region of Theorem [T] matches the 
outer-bounds in Theorem |2] 



Xi. 



' " 




' " 























* 










® 









* 

























1,2- 



(24) 



Xk 



It is worth utilizing Theorem [3] to illustrate the impact of 
feedback on the sum-rate capacity of the linear deterministic 
IC- Consider a symmetric case where rin = 7122 = n, ni2 = 
n2i — an, and Cfbi = Cfbi = I3n. Using Theorem [3] we 
can derive the sum-rate capacity of this network (normalized 




Normalized Interference a 



Fig. 5. Normalized sum-rate capacity for /9 = 0, /9 = 0.125 and / 



by n) 



c. 



= < 



min(2 - 2a + 2/3, 2 - 
min(2a + 2;3, 2 - a) 
2-a 



a) 



a 
2- 



-2/? 



for a e [0, 0.5] 
for a e [0.5, |] 
for a e [|, 1] 
for a e [1,2 + 2/3] 
for a e [2 + 2/3, cx)) 
(25) 

Figure |5] illustrates the (normalized) sum-rate capacity as a 
function of a, for different values of (3 — (i.e., no feedback), 
/3 = 00 (i.e., infinite feedback), and /3 = 0.125. We note the 
following cases: 

• Case 1 (a e [O, j]): In this regime the sum-rate capacity 
is increased by the total amount of feedback rates and 
saturates at 2 — a once the rate of each feedback link is 
larger than 

• Case 2 (a G |]): In this regime the sum-rate capacity 
is increased by the total amount of feedback rates and 
saturates at 2a once the rate of each feedback link is 

1 *u (2n~3ccn) 

larger than ^ 2 ■ 

• Case 3 (a £ [|,2]): In this regime feedback does not 
increase the capacity. 

• Case 4 (a e [2 + 2/3, 00)): In this regime the sum- 
rate capacity is increased by at most the total amount 
of feedback rates. 

Remark 5 (Feedback gain under asymmetric feedback cost): 
As it can be seen in ( [25] l the sum-rate capacity is increased by 
at most the total amount of feedback rates. Let the cost be the 
amount of resources (e.g., time, frequency) paid for sending 
one bit. With this cost in mind, let us consider the effective 
gain of using feedback which counts the cost. Notice that by 
Case 1,2, and 4, there are many channel parameter scenarios 
where one bit of feedback can provide a capacity increase of 
exactly one bit. This implies that the effective feedback gain 
depends on the cost difference between feedback and forward 
links. So if the feedback cost is cheaper than that of using 
forward link, then there is indeed feedback gain. The cellular 
network may be this case. Suppose that downlink is used for 
feedback purpose, while uplink is used as a forward link. 
Then, this is the scenario where the feedback cost is cheaper 
than the cost of using the forward link, as downlink power 
is typically larger than uplink power, thus inducing cheaper 
feedback cost. 
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i?i < log (l + SNRi + INR21 + 2pv/SNRi • INR21) (26a) 

^ ^°s(i + TT(w^)+^°s(^ + ^^-^')'^^-) ^'^^^ 

i?i < log(l + (l-p')SNRi) +Cfb2 (26c) 

i?2 < log (^1 + SNR2 + INR12 + 2pv/SNR2 • INR12) (26d) 

^2 < logfl + -^^-^'^|^')+log(l + (l-/^')INR2i) (26e) 



l + (l-p2)|NR2i, 

i?2 < log(l + (l-p2)SNR2) +Cfbi (26f) 
i?i+i?. < log fl + (1 ~ p^)INR2. + . ) + log fl + (1 - p^)INR . (l-^^)SNR. 



l + (l-p2)|NRi2; ' ' ^ ' ^ l + (l-p2)|NR2i^ 

+ Cfbi + Cfb2 (26g) 

i?i+i?2 < log (^1 + ^ ^ p2^)'lNRi2 ) ^^'^^ 2pVSNR2 ■ INR12) (26h) 

i?i+i?2 < log (^1 + ^ 1^(7 ^'p2^)^NR2i ) ^ ^ ^ '^'^'^ ^ 2pVSNRi ■ INR21) (26i) 

2R1+R2 < log (1 + SNRi + INR21 + 2pVSNRi ■ INR21) + log (l + ^ ^^7 ^^^^^^,1 ) (26j) 
V / \ 1 + (1 - p"')INRi2 J 

+ log (1 + (1 - p^)iNR,2 + YTji^^^^m^) + + ^"'"^^ 

i?i + 2i?2 < log (1 + SNR2 + INR12 + 2pVSNR2 ■ INR12) + log (^1 + ^ 1^(7 ^'^2)')'nr^ J (261) 

+ log (l + il- p^)INR2i + ^ ) + Cfbi + gFB2 (26m) 



1 + (1-/92)|NR 
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VI. Gaussian Interference Channel 

In this section, we consider the Gaussian IC with rate- 
limited feedback, described in Section |Il] We first derive 
an outer-bound on the capacity region of this network. We 
then develop an achievability strategy based on the techniques 
discussed in the previous sections and then show that for 
symmetric channel gains it achieves a sum-rate within a 
constant gap to the optimality. 



A. Outer-bound 

Theorem 4: The capacity region of the Gaussian IC with 
rate-limited feedback is included in the closure of the set C of 



{Ri,R2) satisfying inequalities (26ai-(261i over < p < 1 



Proof: By symmetry, it suffices to prove the bounds 
of d26a|i, ([26b| , ( [26c|, (|26g| ), ( [26h| and ( [26]] l. The bounds 
of ( |26a| i, (26b I and ( |26c[ ) are nothing but cutset bounds. The 
bound of (26h 1 corresponds to the case of infinite feedback rate 



and was derived in |9|. Hence, proving the bounds of (26g 



and (26j 1 is the main focus of this proof. We will present the 



proof of (26gl here, and defer the proof for remaining bounds 
to Appendix |C 

Proof of ( 26g I: The proof idea mostly follows the determin- 
istic case proof of |21g| The only difference in the Gaussian 
case is that we define a noisy version of hi2X^ corresponding 
to V-^ in the deterministic case: S( 
Similarly we define S2 



N 



N 



/i2i^2 +^1 to mimic . With 



this, we can now get: 

N + i?2 - en) < / {Wi-Yf) + / (VK2; ^2"^) 
h (n^) + h (Yi^) - h {S^\W2) ~ h {S^\W,) 



I (5f ; W2) + / (^2^; W,) - h {S^\Y,^) - h {S^\Yi'^ 



h(Yl'\S^)+h(Y2''\S^) 



<T + I (^f , Fi^, 1^1; 1^2) + / (^2^^, W2; Wi 



-h{S'^\Yi\W^,Y{ 
id) 



N 



.W2,Y^ 



T + I (y,^; W2\Wi) + I (5f ; W2\Wi,Yi'') 



+ I (k,"^; Wi\W2) + I (^2^; W^i|W^2, ^2^ 
-hlz^\S^,W2,Y,^)--h[z,^\S^,W,,Y,^) 
^^T-h (Zf ) - h (Z^) +1 (fi^; W2\W, 



+ I (f2^; W^\W2) + I (Z^; S^m,Y,^ 
+ I (Zf ; S^\W2,Yi') - h (Z^\W„ W2,Yi') 
+ h (Zf ) - h (Z^\W,,W2. Yl') + h {Z^) 

ii) J,, fyN. + / /yw. ^r^\^r^ 
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+ / (Zf ; S^W.^Yl') + I (Zf ; S^\W,,Y^ 
+ / (Zf ; + / (Z^; Yl'\Wi,W2 

= r + I (Yi^; W2,Z^\Wi^ + I (rf; Wi, Z^\W2 
+ I (Zf ; S^\W,,Y,^) + I (Zf ; f/) 
= T' + I (Yi^; W2\Wi, Z^^ + I (ff; Wi\W2, 
+ / (fi^, S^; Z^\W,) + / (y/, 5f ; 11^2) 

< T' + / W^2|W^i, ^2^) + / (^2^; W^i|W^2, Zf ) 



AT 



+ /fn^;Z,^|W^i,W^2,^f,y2^ 



T' + / ( Fi^; W^2|W^i, + / [Yi'- W,\W2. Zf 



+ / (f/; Z^^lW^i, M/2, Zf ) + / (y^^; Zf jW^i, W^2, Zf 

= h {Yf\s^) - h (zf ) + h (r/i^^^) - h {Z^) 

+ I W2,Z^\W^,Z^) + I (y,^; M^i, Z2^|W^2, Zf 

W AT 
< ^ [/l (ynl^lO - h {Zu)\ -^Y.^h {Y2^\S2^) - h (Z2.) 



i=l i=l 

H (y.^'IW,, Z^) + H (Yi'\W2,Z^ 



N 



N 



< ^ [/l (YulSu) - h (Zu)] iY2^\S2^) - h (Z2.)] 

4=1 i=l 
N N 

+ J2H(Yu\X^i^+J2H(Y2,\X2i), (27) 



where (a) follows from Fano's inequality; (b) follows from 
the fact that h{Y/^\Wi) = h{Si^\Wi) and h{Yf\W2) = 
/i(S'f IW2) (see Claim p] below); (c) follows from the non- 
negativity of mutual information and the fact that conditioning 
reduces entropy; (d) follows from the fact that is a 
function of (M^fe,y^^~^), and the fact that Wi and W2 
are independent; (e) follows from the fact that X^ is a 
function of {Wk^Y^"'^); (/) follows from the fact that Zf is 
independent of Wi and W2', (g) holds since is a function 
of {Wk, Y^^\Z^_^y, (h) holds since Wi, W2, Zf , and Z^^ 
are mutually independent; (i) holds since 



/(yi^;zf|w^i,w^2,zf,y/ 

N 

= 5^ / (Yu; Z^\W,,W2,Z^, Yf, Yr') 



I (Yu; Z^\Wu W2, Zf , y^^, Yr\X^,X{ 



i=l 
N 



(28) 



= ^ / (fn; Z^\W,, W2, Zf , 12^, yr\ , XlYl) 

i=l 
N 

= I {Yu; Z^\Wu W-2, Zf , Yf, Yl,X^, X\,Yl 

i=l 

= 0. 

Claim 3: h{S^\W2) = h{Yf\W2). 
Proof: 

hiYf\W2)^J2^(^^^\^^'''^^^ 

^=^^M^id>^'-\w^2) 

^='^M^H|yr\M^2,x^,^r') 



YHSu\W2,Sl') = h{S^\W2), 



where (a) follows from the fact that y2i is a function of 
{X2i,Su) and X2i is a function of (1^2, y2*^^); (b) follows 
from the fact that X^ is a function of (VF2,y2"^) and S'f^ 
is a function of {Y2~^ , X2~^); (c) follows from Claim [4](see 
below). ■ 
Claim 4: For all z > 1, X{ is a function of {WijS^'^) and 
is a function of (W2,S'i"^)- 

Proof: By symmetry, it is enough to prove only one. 
Notice that X^ is a function of (VF2,y2"^) and yg"^ is 
a function of (Xj"^, 5*5^^^). Hence, X| is a function of 
(W2, -^^2"^! "^i"^)- Iterating the same argument, we conclude 
that X2 is a function of (W2, X21, S*}^^). Since X21 depends 
only on W2, we complete the proof. ■ 
From the above, we get 



i?i + i?2 < HYi\Si) - h{Zi) + h(Y2\S2) - HZ2) 

+ CfBl + CfB2- 



(29) 



where we have used the fact that H{Yki\Xki) < CpBk and 
conditioning reduces entropy. 

Finally note that for p = £[^1X2], we hav^ 



h{Yi\Si) < log27re 1 + (1 - p')INR2i 



(l-p")SNRi 
l + (l-p2)INRi 



Using ( 30 1, we get the desired upper bound in ( 26g 



If we consider the symmetric channel gains, i.e., 

\hn\ = \h22\ = \hd\, 
\hi2\ = \h2i\ = \h,\, 

and 

SNRi = SNR2 = SNR = \hdf, 
INR12 = INR21 = INR = \hc\^, 

we get the following outer-bound result. 



-p captures the power gain that can be achieved by making the transmit 
signals correlated. 



(30) 



(31) 



(32) 
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Corollary 1: The sum-rate capacity of the symmetric Gaus- 
sian IC with rate-limited feedback is included by the set Csym 
of i?i + i?2 satisfying 



Ri 
Ri 



R2 
R2 



< 
< 



21og(l 
log ( 1 



SNR) - 
SNR 



CfBl + CfB2 



R1+R2 < 



1 + INR 

log (1 + SNR + INR + 2VSNR- INr) 
SNR 



(33a) 
(33b) 



2 log 
Cfbi 



1 + INR 

CfB2- 



1 + INR 



(33c) 



Proof: The proof is straight forward and is a direct 
consequence of the bounds in (26c 1, (26fl, ( |26g[l, and (26hjl. 
For instance, (33ai is derived by combining ( |26c[ i and (26fl 
for p — 0. Note that p — maximizes p6c| l and (26f\ . ■ 

B. Acievability Strategy 

We first provide a brief outline of the achievability. Our 
achievable scheme is based on block Markov encoding with 
backward decoding where the scheme is implemented over B 
blocks. In each block (with the exception of the last two), new 
messages are transmitted. At the end of a block, each receiver 
creates a feedback signal and sends it back to its corresponding 
transmitter. This will provide each transmitter with part of 
the other user's information that caused interference. Each 
transmitter encodes this interfering message and transmit it 
to its receiver during a different block. Through this part of 
the transmitted signal, receivers will be able to complete the 
decoding of the previously received messages. During the last 
two blocks, no new messages will be transmitted and each 
transmitter provides its receiver with the interfering message 
coming from the other transmitter. Later, we let B go to 
infinity to get our desired result. 



As we have seen in Section III each receiver may need to 
decode the superposition of the two codewords (corresponding 
to the other user's cooperative common message and part of 
its own private message). In order to accomplish this in the 
Gaussian case, we employ lattice codes. 

1 ) Lattice Coding Preliminaries: We briefly go over some 
preliminaries on lattice coding and summerize the results that 
will be used later A lattice is a discrete additive subgroup 
of M". The fundamental volume V/(A) of a lattice A is the 
reciprocal of the number of lattice points per unit volume. 

Given integer p, denote the set of integers modulo p by 
Zp. Let Z" Zp : w M- u be the componentwise modulo p 
operation over integer vectors. Also, let C be a linear (n, k) 
code over Z„. The lattice Ac defined as 



Ac = {v eZ" -.v e C}, 



(34) 



is generated with respect to the linear code C (see [321 for 
details). In f32|, it has been shown that there exists good lattice 
codes for point-to-point communication channels, i.e., codes 
that achieve a rate close to the capacity of the channel with 
arbitrary small decoding error probability. We summarize the 
result here. 



Consider a point-to-point communication scenario over an 
additive noise channel 



Y^X + Z, 



(35) 



where X is the transmitted signal with power constraint P, Y 
is the received signal and Z is the additive noise process with 
zero mean and variance a^. 

A set B of linear codes over Zp is called balanced if every 
nonzero element of Z^ is contained in the same number of 
codes in B. Define £b as 



Cb = {Ac:C& B}. 



(36) 



Lemma 1 ([32]): Consider a point-to-point additive noise 
channel described in &5[. Let B he a balanced set of linear 



(n, k) codes over Zp. Averaged over all lattices from the 



set Cj3 defined in (36i, each scaled by 7 > and with a 
fundamental volume V , we have that for any 5 > {), the 
average probability of decoding error is bounded by 



Pe < {l + S) '- 



log (27re(T^ 
V 



(37) 



for sufficiently large p and small 7 such that — V. 

See 1 32 1 for the proof. The next lemma describes the 
existence of a good lattice code for a point-to-point AWGN 
channel. 

Lemma 2 (1 32 J): Consider a point-to-point additive noise 
channel described in ( |35| ) such that the transmitter satisfies 
a power constraint of P. Then, we can choose a lattice A 
generated using construction A, a shift .^and a shaping region 
such that the codebook ( A + s) H achieves a rate R with 
arbitrarily small probability of error if 



1 



^ < o log > 
Z \ a 



(38) 



In other words. Lemma |2] describes the existence of a lattice 
code with sufficient codewords. See |32| for the proof. For a 
more comprehensive review of lattice codes see 1321 . Il33l . 

m. 

Remark 6: In this paper, we consider complex AWGN 
channels. Similar to Lemma |2] one can show that using lattice 
codes, a rate of log (^) is achievable in the complex channel 
setting. 

2) Acievability Strategy for CfBl — Cfb and C^si = 0.' We 
describe our strategy for the extreme case where Cfbi = Cfb 
and Cfb2 = (interchanging user IDs, one can get similar 
results for Cfb2 = Cfb and Cfbi = 0). Our strategy for any 
other feedback configuration will be based on a combination 
of the strategies for these extreme cases. 

Codebook Generation and Encoding: The communica- 
tion strategy consists of B blocks, each of length chan- 
nel uses. In block h, b — 1, 2, . . . , _B — 2, transmitter 1 
has four messages Wi^'''\Wi'^''^\Wi^'''^ and Wi'^'''\ where 



W^f'"^ e {1,2, 



■)NR)' 



}. Out of these four messages. 



Wi^'''\ Wi'^'''^ and Wi'^''''^ are new messages and in particular 

^ Shift s is a vector in R" and it is required in order to prove of existence 
of good lattice codes, see 1 32 1 for more details. 

^We need to consider the intersection of a lattice vifith some shaping region 
S C K" to satisfy the power constraint. 
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Wi^''''' and Wi"^'^^ form the private message of transmitter 
1 while Wi'^ is the non-cooperative message (as it will 
be clarified shortly for the feedback strategy, the reason for 
splitting the private message of transmitter 1 into two parts is 
that in order to be able to use lattice codes, we would like the 
codeword corresponding to the cooperative common message 
of transmitter 2 to be received at the same power level as 
part of the codeword corresponding to the parivate message 
of transmitter 1). We will describe when we explain 

the feedback strategy. On the other hand, transmitter 2 has 
three new independent messages 

the private, the cooperative common, and the non-cooperative 
common message of transmitter 2 respectively. 

At transmitter fc, message wj,^'''^ is mapped to a Gaussian 
codeword xj^''''' picked from a codebook of size 2^^'= and 
any element of this codebook is drawn i.i.d. from CM{0, P^''), 
{k,i) € {(1,1), (1,3), (1,4), (2,1), (2, 3)}. For notational 
simplicity, we have removed the superscript A^. 

Message W^'^^ is mapped to x'^^'^^ encoded by lattice 
A^^'''' with shift s)^'^^ and spherical shaping region ^f'^^.This 
gives a codebook of size 2^^^ with power constraint of 



fc = 1, 2. Denote this codebook by (A 



(2,6) 



,(2,fc) 



(2,fc) 



Transmitter k will superimpose all of its transmitted signals 
to create x''^\ its transmitted signal during block b, i.e.. 



X 



(3,6) 



+ X\ 



(4,&) 



and A, 



(b) 



xY'^+xt'^+xi^'\ 

The power assignments should be such that they are non- 
negative and satisfy the power constraint at each transmitter: 



Our achievable scheme employs different decoding orders 
depending on the channel gains. In other words, based on the 
channel gains the number of required messages to achieve 
the desired sum-rate might vary. In fact based on the channel 
gains, it might be sufficient to consider fewer messages than 
suggested above. In such cases, we assume the unnecessary 
messages to be deterministic {i.e., the corresponding rate to 
be zero). In particular, we have three different cases. 
Case (a) log(INR) < ilog(SNR): 

In this case, we set R^^^ = r!"2^ = 0. In other words, W^^^^-* 
and W2 are deterministic messages. We then get 



(a1^) 



A 



A 



(3) 



{xi^ 



X. 



(2) 



Zi. 
(41) 



(3) 

At the end of each block, receiver 1 first decodes A; by 

(3) 

treating all other codewords as noise. A^ can be decoded 
with small error probability if 



Ri ^ < log 



(3) 



1 + INRP2 + SNRP| 



(3) 

It then removes hdX{ from the received signal and 
decodes A^^-* by treating other codewords as noise. a{^^^ is 
decodable at receiver 1 with arbitrary small error probability 
if 



(1:2) 



(42) 



R^i^ < log 1 



smpi 



(1) 



l + INRP2 + SNRPi^ 



(2) 



(43) 



P2^P2 



(1) 



P 



(2) 



Pf < 1. 



(39) 



Feedback Strategy: Our feedback strategy is inspired by 



the motivating example in Section III Remember that in this 



example, receiver 2 had to feed back the superposition of the 
two codewords (corresponding to transmitter I's cooperative 
common message and part of its private message). To realize 
this in the Gaussian case, we incorporate lattice coding with 
appropriate power assignment as part of our strategy. 



We set SNRPf ^ = INRP 
arrive at the same power level at receiver 1 and therefore 

hdX[~'' 



(2) 



so that A 



(2,f>) 



and A. 



(2,b) 



(2,&) 



index as / 



hcXlf'''^ is a lattice point. We refer to this lattice 

(b) 

A1.2 



Receiver 1 then feeds ( /i''^ mod 2^<^fb 



Al.: 



back to transmitter 1. 



Given ^ mod 2^'-^'='' j, transmitter 1 removes hdX['^'''^ 

.(2,fc) 



After removing hdX[^\ receiver 1 has access to /i^Ap'' + 
haX^ + hcX^^^ + Zi. Since we have set SNRPf^ 

(2) f2) (2) 

is a lattice point with some index 
Ij^^ ^ . Receiver 1 decodes ij^^ ^ by treating other codewords as 

noise, and sends back [if^ mod 2^'-^'''^ ) to transmitter 1. 



From Lemma |2] decoding with arbitrary small error probability 
is feasible if 



P^?< 



log 



log 



SNRPj^ 



(2) 



1 + INRP 



(1) 



inrp: 



(2) 



-1 + 



1 + INRP 



(1) 



(44) 



Here [•]+ = max{-,0}. 

The decoding at receiver 2 proceeds as follows. At the end 

(3) 



and decodes the message index of 14^2 . This can be done as of each block, receiver 2 removes /icA}^ from its received 
long as the total number of lattice points for either of the two 
ahgned messages is less than 2^*^™, i.e., R^'^\ ^2^''''' < C\ 
Since the feedback transmission itself lasts a block, we set 



FB- 



(3,&+2) 



(2,fc) 



Decoding: For notational simplicity, we ignore the block 
index and from our description it is clear whether the two 
signals belong to the same block or different ones. We also 
use the following shorthand notation: 



signal. Note that A^^^ is in fact a function of W^'^^"^^ and 
thus it is known to receiver 2 (assuming successful decoding 
in the previous blocks). Therefore, after removing h^xf^, we 
get 



X. 



(1) 



A, 



(2) 



hriX 



A 



(2) 



(45) 



p; 



(1) 



p, 



(i) 



1,2. 



Receiver 2 now decodes X^^ and X^^ by treating other 
(40) codewords as noise. This can be done with arbitrary small 
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(46) 



The decoding strategy presented above describes a set of 
constraints on the rates, which is summarized as follows: 



<log(l 
< min log 
i?f ^ < log ( 1 



r: 



(1) 



(2) 



< log 1 



< min 




(47) 



Therefore, we can achieve a sum-rate R^j^ 



R^2^ + R^2^, ai-biti-ai-y close tc|^ 



R 



(1)^^(2) 



R 



(a) 
SUM 



= log 1 



SNRP| 



INRP2 + SNRPf^ 

snrpP 

1 + INRP^^^ 



log 1 




(1) 



FB 



(1) 



(1:2) 



INRP2^^^ 
INRP 



(1) 



FB 



(48) 



Case (b) ilog(SNR) < log(INR) < |log(SNR): In this 
case, we have 



X 



(1) 



X 



(2) 



X 



(3) 



X 



(4) 



hAX. 



^(1) 



X. 



(2) 



X. 



(3) 



Zi. 



(49) 



At the end of each block, receiver 1 first decodes x'f^ by 
treating all other codewords as noise, and removes /i^^j^^ 
from the received signal. This can be decoded with small error 
probability if 



Pj^^ < log 1 



SNRPi^ 



(4) 



1 + INRP2 + SNRP| 



(1:3) 



(50) 



(3) 

Next, it decodes X) by treating other codewords as noise 
and removes hdXi ' from the received signal. This can be 

^Note that x'^'^^ is a function of tiie cooperative common message of 
transmitter 2, i.e., w'^^'^ lience, it does not contain any new information 
and it is not considered in tlie sum-rate. 



decoded with arbitrary small error probability if 

SNRPf^ ^ 



Rx^ < log 



1 



1 + INRP2 + SNRPi^ 



(1:2) 



(51) 



We proceed by decoding the non-cooperative common mes- 

(3) 

sage of transmitter 2, i.e., X^ by treating other codewords 
as noise. This can be decoded with arbitrary small error 
probability if 



< log 1 



INRP 



(3) 



1 + INRP 



(1:2) 



SNRP| 



(1:2) 



(52) 



f3) 

It then removes hcX^ from the received signal, having 



now access to hdX\ + hcXl^' + hdX\^' + /icX 

(2) f2) 

We decode the lattice index of h^Xl ' + hf.X\ ' , i 
by treating other codewords as noise. It then sends back 



(2) 



'(1) 
2 

i.e.. 



rib) 



^ mod 2^'-^'''^ j to transmitter 1. From Lemma 
ing with arbitrary small error probability is feasible T 



decod- 



log 



log 



SNRP| 



(2) 



l + INRPa'^^ +SNRPi^^\ 



INRP 



(2) 



H + 



1 + INRP2^^^ +SNRPi^ 



(1) 



(53) 



After decoding and removing h^X) 
^(1) 



(2) 



u v{2) 

/icAj , receiver 



1 decodes X^ '. This can be done with arbitrary small error 
probability if 



i^[^^<log !■ ^"'^^ 



(1) 



1 + INRP 



(1) 



(54) 



(3) 

Similar to the previous case, receiver 2 removes X^ from 
its received signal. The decoding at receiver 2 proceeds as 

(3) 

follows. Receiver 2 decodes by treating other codewords 

(3) 

as noise and removes h^Xk from the received signal. Next, 

(2) 

X2 , the non-cooperative common message of transmitter 

1, will be decoded while treating other codewords as noise. 

(2) 

Receiver 2 removes hdX2 from the received signal and then, 
decodes x['^^ by treating other codewords as noise. After 
removing hcX['^\ we now decode the private message of 
transmitter 2, i.e., X2^\ This can be done with arbitrary small 
error probability if 



Pf < log 1 



SNRP 



(3) 



1 + SNRPa'^^^^ + INR(Pi - pf')^ 



log 



SNRP 



(2) 



l-fSNRPa^^^ + INR(Pi - 



(3)n 



R^l ^ < log 1 



pW < log 1 



INRP 



(4) 



(55) 



l + INRPi*^^^^+SNRP2*^^ 



SNRP 



(1) 



1 + INRP, 



(1:2) 
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The decoding strategy presented above describes a set of 
constraints on the rates, which is summarized as follows: 



R[^^ < log ( 1 



R 



(2) 



(3) 



(4) 



i?: 



(1) 



i?: 



(2) 



(3) 




(1) 



SNRP^ 
1 + INRP' 



l0g( SNR^i ^ 

^ ' 1 + INRP2<^'+SNRP{^> 



SNRPj*^' 
l + INRPa+SNRPj*^ 

INRPf*' 



FB 



1 + INRP^ 
SNRP* 



1 + INRP) 



(1:2) 



-SNRP,^ 



INRP,^ 



l + INRP2<^'+SNRPi<^' 



FB 



INRPJ' 



1 + INRP 



<i^^'^SNRP<i^ = > 



(56) 



Therefore, we can achieve a sum-rate i?suM ~ +-^1 



R' 



(4) 



(1) 



R. 



(2) 



2 -r R^\ arbitrary close ti 




(57) 



FB 



2 T-SNRP^^' 



FB 



+ log 1 



(3) 



1 + INRP2'^'^^ +SNRP|' 

Case (c) 21og(SNR) < log(INR): 

In this case, there is no need to decode the superposition of 
the two messages. So set r']^\ r''^^ and R^^ equal to zero. 
We then get 

Yi ^ hd (xj'' + Xj^') + h, (xf ) + + Zi, (58) 

Y, ^ h, [x^'^ + X^) + K (Xf ) + X['-^) + Z,. (59) 

(2) 

As for the feedback strategy, receiver 1 decodes X2 by 
treating other codewords as noise, and sends the lattice index 
of W2 back to transmitter 1 during the following block. 

(3) 

Transmitter 1 later encodes this message as X-l and transmits 
it. It is worth mentioning that in this case, it is in fact receiver 
2 who wants to exploit the feedback link of user 1 to get 
part of its message. In other words, we have two paths for 

*Note that X^'*"' is a function of tlie cooperative common message of 
transmitter 2, i.e., W^'^ lience it is not considered in tlie sum-rate. 



3(1:2) 



information flow from transmitter 2 to receiver 2; one through 
the direct link between them and the other one through receiver 
1, feedback link and transmitter 1. The decoding works very 
similar to what we described above and we get the following 
set of constraints to guarantee small error probability at the 
decoders. 



R\ 



(3) 



R\ 



(4) 



R^ 



(2) 



(3) 




(60) 



R^ 



As before xf"'^'^ is a function of W^^ 



can achieve a sum-rate R. 
close to 



(c) _ p(4) 
SUM 



(2,6-2) 
(2) / 



R. 



Therefore, we 
r'"2 \ arbitrary 



R. 



ic) _ 
SUM 



= log 



l+SNRPf\ 




INRP 



(2) 



n + 



SNRPi 



FB 



log 1 ' 



1 + SNRP 



(2) 



(61) 



Case (d) |log(SNR) <log(INR) <21og(SNR): 

As we will show in Appendix [P} in this regime feedback can 
at most increase the sum-rate capacity by 4 bits/sec/Hz. Hence, 
we ignore the feedback and use the non-feedback transmission 
strategy in [35 1 (i.e., having only one private and one common 
message at each transmitter and jointly decoding at receivers). 

3) General Feedback Assignment: We now describe our 
achievable scheme for general feedback capacity assignment 
based on a combination of the achievability schemes for the 
extreme cases. Let Cfbi = ACfb and Cfb2 = (I^^)C'fb. such 
that < A < 1. We call the achievable sum-rate of the extreme 
case Cfbi = Cfb and Cfb2 = by Psum~°' ^^'^ similarly, 
we refer to the achievable sum-rate of the other extreme case 



by R. 



Cfbi=0 
SUM ■ 



We split any block 6, 6 = 1, 2, . . . , B - 2, of 



Feedback Transmission 

for the previous block 




Fig. 6. Aciiievability strategy for CpBi = ^<^fb 2nd Cfb2 = (1 ~ ^)C'fb- 

length N into two sub-blocks: hi of length \N and 62 of 
length (1 — \)N. See Figure |6] for a depiction. During block 
hi, we implement the transmission strategy of the extreme case 
Cfbi — Cfb and Cfb2 — 0. with a block length of AA^; and 
during block 62, the achievability scheme of the extreme case 
Cfbi = and Cfb2 = Cfb, with a block length of (1 — A) N . 
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At the end of each sub-block, receivers decode the messages 
as described before and create the feedback messages. During 
block 5+1 the feedback messages of sub-blocks bi and 62 
will be sent back to corresponding transmitters, as shown in 
Figure |6] Note that we use Cfbi during the entire length of 
block 6+1, hence the effective feedback rate of user 1 (total 
feedback use divided by number of transmission time slots), 
would be 



r" 



eff 
FBI 



XN 



XN 



FB- 



(62) 



Hence, we can implement the achievability strategy corre- 
sponding to the extreme case Cfbi — Cfb and Cfb2 = 0. 
Similar argument is valid for the other extreme case. With 
this achievability scheme, as N goes to infinity, we achieve a 
sum-rate of XRf^%^^ + (1 - A) Rs(i%^° ■ 

4) Power Splitting: We have yet to specify the values of the 
powers associated with the codewords at the transmitters (i.e., 
Pjf^: k e {1,2}, i e {1,2,3,4}). In general, one can solve 
an optimization problem to find the optimal choice of power 
level assignments that maximizes the achievable sum-rate. 
We have performed numerical analysis for this optimization 
problem. Figure [7] shows the gap between our proposed 
achievable scheme and the outer-bounds in Corollary [T] at (a) 
SNR = 20dB, (b) SNR = 40dB, and (c) SNR = 60dB, for 
Cfb = 10 bits. In fact through our numerical analysis, we 
can see that the gap is at most 4, 5, and 5.5 bits/sec/Hz for 
the given values of SNR, respectively. Note that sharp points 
in Figure |7] are due to the change of achievability scheme for 
different values of INR as described before. 

In Appendix |D] we present an explicit choice of power as- 
signments such that the gap between the achievability scheme 
and the outer-bounds does not scale with SNR. As a result, 
we get the following Theorem. 

Theorem 5: The sum-rate capacity of the Gaussian IC with 
rate-limited feedback is within at most 14.8 bits/sec/Hz of the 
maximum Ri + R2 satisfying 

0<i?i + i?2 < 21og(l + SNR) + CFBi + CFB2 (63a) 
0<i?i + i?2 < log(l + -^'^) (63b) 



0<i?i + i?2 < 21og 1 + INR 



1 + INRy 
log (1 + SNR + INR + 2\/SNR- INR 
SNR 



1 + INR 



(63c) 



FBI 



FBI- 



Remark 7: Note that the given choice of power assignment 
in Appendix [D] is not necessarily optimal, and our analysis 
is pessimistic in the sense that we consider the worst case 
scenario, and we calculate the gap for the worst case. 

As a corollary, we characterize the symmetric capacity 
of the two-user Gaussian IC with rate-limited feedback, as 
defined below, to within a constant number of bits. 

Definition 1: The symmetric capacity is defined by 



Csym =SUp{i?: eC}, 



(64) 



SNR = 20dB 




20 30 40 50 60 



INR (dB) 
(a) 




where C is the capacity region. 



Fig. 7. Numerical analysis: gap between achievable scheme and the outer- 
bounds in Corollary [T] at (a) SNR = 20dB, (b) SNR = 40dB, and (c) 
SNR = 60dB for Cfb = 10 bits. 



Corollary 2: For the symmetric Gaussian IC with equal 
feedback link capacities, i.e., Cfbi — Cfb2, the pre- 
sented achievability strategy achieves to within at most 7.4 
bits/sec/Hz/user to the symmetric capacity Csym defined in 
(|64]), for all channel gains. 

Proof: Theorem |5] says that we can achieve to within at 
most 14.8 bits/sec/Hz of the outerbounds in Corollary [T] for 
any feedback assignment. Therefore, in symmetric IC with 
equal feedback link capacities Cfbi = Cfb2 = ^Cfbi, the 
gap between the achievability and the symmetric capacity is 
at most 7.4 bits/sec/Hz/user. ■ 

VII. Concluding Remarks 

We have addressed the two-user interference channel with 
rate-limited feedback under three different models: the El 
Gamal-Costa deterministic model 1 1 1 1, the linear deterministic 
model fTH . and the Gaussian model. We developed new 
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achievable schemes and new outer-bounds for all of the three 
models. We showed the optimality of our scheme under the 
linear deterministic model. Under the Gaussian model, we 
established new outer-bounds on the capacity region with rate- 
limited feedback, and we proposed a transmission strategy 
employing lattice codes and the ideas developed in the first 
two models. Furthermore, we proved that the gap between the 
achievable sum-rate of the proposed scheme and the outer- 
bound is bounded by a constant number of bits, independent 
of the channel gains. 

One of the future directions would be to extend this result 
to the capacity region of the asymmetric two-user Gaussian 
interference channel with rate-limited feedback. The same 
achievability scheme can be applied there, however, the gap 
analysis will be cumbersome. Therefore, one interesting direc- 
tion is to find out new techniques to bound the gap between the 
achievable region and the outer-bounds on the capacity region 
of the asymmetric two-user Gaussian interference channel with 
rate-Umited feedback. 



Appendix A 
Proof of Theorem|2] 



Proof of 1 21a) (cutset bound): Starting with Fano's in- 
equality, we get 



N{Ri-eN)<I{Wi-Y{ 



where the second inequality follows from the fact that con- 
ditioning reduces entropy. If (i?i,i?2) is achievable, then 
Eat — > as — > oo. Thus we obtain the left term of the 
bound. Notice that this is a cutset bound, as the bound is 
obtained assuming that the two transmitters fully collaborate. 
To obtain the right term, we consider 

NiRi ~ ew) < /(W^i; Fi^, F/, W2) 

^ H{Yu, Y,,\W2, Yr\Yr\X^ 
= Y.H{Yu\W2,Yr\Yi,Xl) 
+ Y.H{Y2.\W2,Yr\Yr\X^^) 

^ if (Fn I W^2, F^ \ F2,, C/h) 



< H{Yu\Vu, V2.,, Uu) + J2 H{Y2^\X2^, Uu) , 

where (a) follows from the fact that Wi is independent from 
W2, and X2 is a function of (^2,^2^^); (6) follows from 
the fact that Uu := {X^~^,Y^~^) and ^2^^ is a function 
of 1^2"^; (c) follows from the fact that conditioning reduces 
entropy; (d) follows from the fact that {Vu is a function of 
{X2i, Y2i), Y2i is a function of {X2i, Vu) and V2i is a function 
of X2i. Thus we get the right term of the bound. Notice that 
this is a cutset bound, as the bound is obtained assuming that 
the two receivers fully collaborate. 



Proof of ( |21b) (cutset bound): Starting with Fano's in- 
equality, we get: 

N(R^~eN) < I{WuY,^,Y2^,W2) 

^Y.H(Yu\W2,Yr\Yr\Xi) 
+ Y,H{Y2,\W2,YI,Yr\Xi) 

<Y,H{Yu\X2^,Uu)+Y,HiY2^\Yu,X2^) 
< ^ H{Yu\X2^, Uu) + NCfB2, 

where (a) follows from the fact that Wi is independent from 
W2, and X2 is a function of (W^2,^2'^^)' (^) follows from 
the fact that conditioning reduces entropy; (d) follows from 
H{Y2i\Yu, X2i) < Cfb2- Therefore, we get the desired bound. 
Proof of ( |21e[ l: Starting with Fano's inequality, we get 

N{Ri +R2- ew) < /(l^i; Fi^lVKa) + I{W2;Yi') 
^HiYl'\W2)+IiW2;Yf) 
= H{Yl'\W2)+H{Yi') 
- K/^|W^2) - , W2)] 



HiY.'^lYf, W2) - H{Yf\Y,^, W2) + H{Yf) 



(a) 



(b) 



J2 H{Yu\W2,Yr\Yf,Xl Vu) + H{Yf) 



< [H{Yu\V2^, Vu, Uu) + H{Y2i)] , 

where (a) follows from the fact that X2 is a function of 
{W2,Y^-^) and Vu is a function of {X2i,Y2i); (b) follows 
from the fact that Uu is a function of {X'2^^,Y^-^) and 
conditioning reduces entropy. 
Proof of ( |21h) : 

N{2Ri+R2~eN) 

< liWuYf) + I{WuY,^\W2) + I{W2;Y2^) 

< [HiY,'')-H{Y,''\W,)] 

+ /(W-i; Fi^, <|W^2) + [i?(r2^) - ^^(^2^11^2)] 

[ff(yi^) - HiVi'lW,)] + H{V,''\W2) 
+ H{Y,''\W2, 1/1^) + [HiYi") - ^(^1^11^2)] 
= H{Y^)+}i{Y^\W2,V^) 
^H{Y^)-{B{V^)-muV^)\ 

< nWuVi") + + HiY^^\W2, 1^1^) 
+ H{Y2'',V2'')~H{V2'') 

(d) 

< I{W^-Vi',W2,Yi')+H{Y,^) 
+ H{Y,''\W2, n"^) + H{Yf\V2'') 

IiWuY2''\W2) + H{Yf) 
+ H{Y,^\W2, Vf,X^, ) + HiY2''\V2'') 

< A^Cfb2 + J2 ^(^1*) + J2 H{Y2,\V2i) 
+ ^/i'(FH|FH,t/2^,C/n), 
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where (a) follows from the fact that adding information 
increases mutual information; (6) follows from Claim [TJ (c) 
follows from providing to receiver 2; (d) follows from 
the fact that adding information increases mutual information; 
follows from the fact that V/^ is a function of {Wk,Y^^^y, 
(e) follows from the fact that X2 is a function of {W2,V^^^^) 
(by Claim D and Yf is a function of (Xf , V/^); (/) follows 
from the fact that C/i, {X'^^^Y^^'^), U2i := {X{-^ .Yl^^), 
H{Y^\W2) < iVCFB2 and conditioning reduces entropy. 

To complete the proof, we will show that given Ui := 
{Uii,U2i), Xii and X2i are conditionally independent. Re- 
member that our input distribution is of the form of 

p{ui,U2)p{xi\ui,U2)pix2\ui,U2). 



Claim 5: Given 



iUu,U2i) 



{Xir\Y^-\Xl-'-,Yl~'-), Xu and X2^ are conditionally 
independent. 

Proof: The proof is based on the dependence-balance- 
bound technique fTT\, f28l|. For completeness we describe 
details. We first show that I{Wi\W2\Ui) = 0, implying that 
Wi and W2 are independent given Ui. We will then show that 
Xii and X2i are conditionally independent given Ui. 

Consider 

< I{Wi-W2\Ui) I{Wi;W2\U^) - I{Wi-W2) 

-H{Wi) - H{W2) - H{Ui) + ^(14^1, 1^2) 
+ H{Wi, Ui) + HiW2, Ui) - H{Wi,W2,U,) 



-H{U,) + H{U,\Wi) + H{U,\W2) 

i-l 

Y,[-H{X,„X2,\Xr\Xi-') 



(e) 



+H{Xij,X2j\Wi,Xr\Xi-^) 
+H{X,^,X2,\W2,Xr\Xf') 

z-l 

Y,[-H{Xi„x2j\xr\xr') 



3 = 1 



HiX2,\Wi,Xi,Xf')+H{Xi,\W2,Xi-\Xi) 

I— I 

Y,[-H{x,,\xr\xr')+H{x,,\w2,xr\xi) 



(/) 



-HiX2j\Xi,Xi-') + HiX2,m,Xi,Xf')\ < 0, 

where (a) follows from I{Wi;W2) — 0; (b) follows 
from the chain rule; (c) follows from the chain rule and 
H{U^\Wi,W2) = 0; (d) follows from the fact that (Yij, fsj) is 
a function of {Xij,X2j)', (e) follows from the fact that Xkj is 
a function of {Wk, X(~^ , Xi^~^); (/) follows from the fact that 
conditioning reduces entropy. Therefore, I{Wi;W2\Ui) = 0, 
which shows the independence of Wi and 14^2 given Ui. 

Notice that Xki is a function of {Wk, Xl~^ , X^^^). 
Hence, it easily follows that I{Xii; X2i\Ui) — 
I{Xii; X2i\Xl'^^ , X2'^^) — 0. This proves the independence 
of Xu and X2i given Ui. ■ 



Appendix B 

ACHIEVABILITY PROOF OF THEOREm[3] 

With the choice of distribution given in ([23|, we have 



(Si =/(fi;yi|[/,t/2,Xi) =0, 
S2^I{Y2;Y2\U,UuX2)^Q, 
I{U,V2,Xi;Yi) = max(nii,n2i), 
I{U,Vi,X2;Y2) = max(n22,ni2), 
I{X,;Y,\U,Vi,V2) = (nii-ni2)+, 
I{X2;Y2\U,Vi,V2) = (n22-n2i)+, 
/(C/2;ri|t/,Xi) =min(n2i,CFBi), 
/(C/i; Fait/, X2) = min(ni2, Cfb2), 
I{Xi;Yi\U,UuV2) = (nii-ni2) + 
+ min{nii, (ni2 - Cfb2)^} , 
I{X2;Y2\U,U2,Vi) - (n22-n2i) + 
+ min{n22, ("21 - Cfbi)^} , 
I{Xi,V2;Yi\U,Vi,U2) - 

("21 - CfBl)^ + [("-11 - "12)^ - «2l]^ 

+ min{(nii - 7112)+, min(n2i, Cfbi)} , 
I{X2,Vi:Y2\U,V2,Ui) = 
{ni2 - Cfb2)^ + [("22 - "-21)^ - '^12] ^ 

+ min{(n22 - ^^2l)^, min(ni2, C'fb2)} , 
I{XuV2.Y^\U.UuU2) = 
{flu - 1212)^ + min {rill, {ni2 - Cfb2)"''} 

+ [7121 - max {7111, min(n2i, C'fbi)}]^ 



(65a) 
(65b) 
(65c) 
(65d) 
(65e) 
(65f) 
(65g) 
(65h) 

(65i) 

(65j) 
(65k) 



(651) 



(65m) 



(65n) 



iin|n2i, [nil - ("12 - C'fb2)^]^| 

-max{min(n2i,CFBi), ("ii - "12)^}]^ , 

I{X2,Vi;Y2\U,Ui,U2) - 

(^22 - "21)+ + min {^22, (rt2i - Cfbi)^} 
+ [ni2 - max{n22,min(ni2, Cfb2)}]^ 
+ min|ni2, [^22 - ("21 - Cfbi)^]^! 

-max{min(ni2,CFB2), ("22 - "21)^}]^ • 



Using this computation, one can show that the inequalities of 
are implied by ( [TOb]i, dTOdli, rfTOe| and ( [TO^ ; 
lOkli is impUed by ( |10b^ , ( |10d{ and ( [TO]]i ; and 



(lOgi and (lOh 



10m I is implied by ( 10b 1, (lOd 1 and (101 1. We 



the inequality 
the inequality ( 

omit the tedious calculation. With further computation, we get: 



Ri < max(nii,n2i) (66a) 

^1 < ("11 - "12)^ +niin{nii, (ni2 - Cfb2)^} 

+ miii(ni2, Cfb2) (66b) 

i?2 < max(n22,"i2) (66c) 



R2 



< 



{n22 - "21)^ + min {7122, ("21 - C'fbi)^} 
+ min(n2i, Cfbi) (66d) 
R1+R2 < (nil - ni2)+ + max(ri22,"i2) (66e) 
R1+R2 < ("22 - "21)^ + niax(nii,n2i) (66f) 
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i?i+i?2 < max { (7111 - ni2)+, 7^21} (66g) 

+ max{(n22 - "■2i)^,ni2} 

+ min{(riii -ni2)+,7i2i,C'FBi} 

+ min{(n22 -r7,2i)+,ni2,CFB2} 

2i?i + i?2 < (nil - ni2)+ + niax(nii,n2i) (66h) 

+ max{(7l22 - 77,21 )+,ni2} 

+ min {(7722 - 772l)+, 7212, CfB2} 

Ri + 2i?2 < (?^22 ~ '^21)^ + niax(?222, n-12) (66i) 

+ max { (7711 - 7712)+, 7721} 

+ mill {(7711 -7712)+, 7721, Cfbi} • 

We will show that the inequalities developed above are 
equivalent to the capacity region in Theorem [3] Note that (66b 1 
can be written as 



Ri < 



nil + Cfb2, 
max(77ii, 7112) 



"11 + Cfb2 < "^12; 
otherwise. 



This shows that this inequality is implied by ( 22a 1 and ( 22b 1 



Similarly, (66di is implied by (22c 1 and (22di. Next consider 
( |66il ), 

• if Cfbi < min{(77ii - 7712)+, 7721}, 
Cfb2 < min{(7722 - ri2i)+,"i2}: 



(67) 



FB2, 



i?i + i?2 < max {(7211 - 7712)+, 7721 } 

+ max {(7722 - "-21)^, "12} + C'fbi 

• if C'fbi > min {(7711 - 7712)+, 7721}, 
Cfb2 > min {(7722 - 77,21)+, "12}: 

-Ri +i?2 < max(77ii, 77,12) + max(r72i,7722), (68) 

• if C'fbi < min {(7711 - 7712)+, 7721}, 
Cfb2 > min{(7722 - 77,21)+, "12}: 

Ri+ R2 < max {(r7ii - 7712) + , 7721} + Cfbi + n-12 (69) 
+ (7122 - "21)+, 

• and finally, if Cfbi > min{(r7ii — 7712) + , 7721}, 
Cfb2 < min {(7722 - 7721)+, "12}: 

Ri+ R2 < max {(7722 ~ ?^2i)+,"i2} + Cfb2 + "21 (70) 
+ (77,11 - "-12)+- 



Note that the first case is implied by (22gi; and the second 
case is implied by ( |22a[ ) and ( |22c[ ). Also notice that the third 
case is implied by ( |22c| i and ( |22i[ ); and the last case is implied 
by (22a I and (22hi. Lastly, we consider ( |66h| i: 

(7711 - "12)+ + max(77ll, 772l) 

+ max {(7722 - 772i) + ,r7i2} + Cfb2, 

if Cfb2 < min {(7^22 - '^21)"'", "12}; 
max(77ii, 7212) + max(77ii, 772i) 
+ (7722 - ri2i) + , 

if Cfb2 > min {(7722 - 772i)+, 7712}. 

Note that the first case is implied by (j22h|; and the second 
case is implied by (|22a[) and p2f|). Similarly, it can be shown 



2i?i + i?2 < <^ 



that (66ii is implied by (|22i|i, (|22c|i and (22ei. Therefore, the 



inequalities of (66ai-( [66i) l are equivalent to those of (22ai 
( |22i[ l, thus proving the achievablity of Theorem [3] 



Appendix C 
Proof of Theorem|4] 



Proof of ^26a) and ( |26b) : Stalling with Fano's inequality, 
we get 

NiRi-eN) <I{Wi;Yf) 

< Y^iHYu) - h{Yu\Wi,Yl-\Xu)] 
= J2[hiYu) - h{Zu)], 

where the second inequality follows from the fact that condi- 
tioning reduces entropy and Xu is a function of {Wi, Y^^^); 
and the third equality follows from the memoryless property 
of the channel. If (i?i,i?2) is achievable, then ejv — > as 
N ^ 00. Assume that Xi and X2 have covariance p, i.e., 



p = E[XiX^]. We can then obtain ( p6a| ) 
To obtain (|26b|), consider 



N{Ri ~ en) < I{Wi;Y,^,Yi'\W2) 

= J2 HYu, Y2,\W2, Yr\Yr') - HY,'', r2'^|M^i, H^2) 

J2 KYu , ^2^ I W^2 ,Yr\ Y^-\ X2d 
-J2[HZu) + h{Z2^)] 

^=^^/7(i"2.iw^2,rri,yri,x2.) 

+ J2 h{Yu\W2,Y^,X2.,, Sli) - Y.[h{Zu) + h{Z2^)] 

< 51 [^(^2.1^20-/^(^2.)] 
+ Y,[h{Yu\X2^,Sl,)~h{Zli)], 

where (a) follows from the fact that X\ is a function of 

{W2,y;-^) and /7(yi^,r2^|w^i, w^2) = T^HZu) + M^2.)] 

(see Claim |6] below); {b) follows from the fact that S\ 
hi2X\ + Z2 is a function of (^2*'-'^2); (c) follows from the 
fact that conditioning reduces entropy. Hence, we get 

Ri < h{Y2\X2) - h{Z2) + h{Yi\X2, Si) - h{Zi) 
< log(l + (l-|pniNRi2) 



+ 



log fl 



(l-lpP)SNRi 



l + (l-|p|2)INRi2; ' 
where (a) follows from the fact that 

h{Y2\X2) < log2^e (1 + (1 - \p\^)\mi2) 
h{Yi\X2,Si)<\og2TTe (1 



(l-lp^SNRi 



1 



(1- |pP)INRi2 



(71) 
(72) 



The inequality of (72i is obtained as follows. Given {X2, Si), 
the variance of Yi is upper-bounded by 



W?ii[Yi\X2,Si]<KY,~KY, 



(X2 ,Si ) ,Si ) Yi (X2 ,Si ) ' 
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where 



K 



Yt{X2.Si) 



1 + SNRi + INR21 + phl^h2i + p*hiih*2i, 
E[Y,[X;,Sl]] 

[phii + /121, hl2hii + p*h2ih\2] , 



{X2,Sl 



= E 



\X2? X2SI 
X2S1 IS'ip 



1 

phi2 



P*hl2 
I + INR12 



(73) 



By further calculation, we can get (|72]). 

Claim 6: h{Yl^ , Y^^ | W^i , ) = ( , S'f | VTi , W2 ) = 

Y.[h{Zu)+h{Z2^)]. 

Proof: 

h{Yl^,Y2''\W^,W2) ^Y.^{Yu,Y2.\W,,W2,Yr\Yr') 
HYu, Y2^\Wi, W2,Y^-\Yr\Xu,X2i) 
'-^ J2 hiZu,Z2,\Wi, W2,Yl-\Y^~\Xu, X2i) 

i ^ [h{Zu) + h{Z2i)\ , 

where (a) follows from the fact that Xn is a function of 
{Wi,Yl~^) and X2^ is a function of {W2,Y^^^y, (b) follows 
from the fact that Yu — huXu + h2iX2i + Zu and Su :— 
hi2Xii + Z2i\ (c) follows from the memoryless property of 
the channel and the independence assumption of Zu and 
Z2i. Similarly, one can show that h{Y^ ,S^\Wx,W2) = 

Proof of pScl: Starting with Fano's inequality, we get 



X{Ry - e^v) < muY^,Y^\W2) 

= ^ h{Yu. Y2.\W2,Yr\Y^-') - Mn"^, Yi'\W,,W2) 

< HYu, Y2^\W2, Yl-\Y^\X2^) - Y KZu) 
^YHiMW2,Yr\Yr\X2^) 

+ Y h{Yu\W2,Yr\n,X2{) - Y HZu) 

(6) ^ 

< NCfb2 + ^[/l(yH|X2.) - h{Zu)], 

where (a) follows from the fact that l^fll^i, > 

'^h{Zii) (see Claim [t] below) and X2i is a function of 
(1^2,i^2~^); (c) follows from the fact that H(Y2^) < Cfb2 
and conditioning reduces entropy. So we get 

Ri < h{Yi\X2) - h{Zi) + CfB2 

<l0g(l + (l-|/9|2)SNRi)+CFB2. 

Claim 7: h{Yf ,Yf\Wi,W2) >J2HZu). 
Proof: 

h(Y,^, Y2''\Wi,W2) - 1^2) 



h{Y,^\W^,W2,Y2'') 



(a) 



= Y hiZu\W,,W2, Yr\Yt\Xu,X: 



2i) 



where (a) follows from the fact that entropy is nonnegative 
and Xii is a function of (VFi, i^^) and X2i is a function of 
{W2, ^2*^)' (^) follows from the memoryless property of the 
channel. ■ 
Proof of ( [26h) : 

iV(i?i + i?2 - ew) < nW^Y^) + /(W^2; ^^2"^) 
'< I{Wi-Yl', S^,W2) + I{W2;Yi') 
=^ Mn"^, 5^11^2) - Mn"^, 5f iVFi, W^2) + /(W2; ) 

''^ , w^2) - '^(^1*) + ^^(^2"^) - E ^(^2.) 
/^(ri^l^f , W2. x^) - Y KZii) + KY2'') - Y f'(Z2^) 



f) 



N 



< Y [hiYu\Su,X2.0 ~ h{Zu) + KY2i) - h{Z2^)] 



where (a) follows from the fact that adding information 
increases mutual information (providing a genie); (b) follows 
from the independence of Wi and W2', (c) follows from 
h{Y,^,S^\Wi,W2) = J:[hiZu)+HZ2^)] (see Claim §; 
(d) follows from h{S^\W2) = h{Y2^\W2) (see Claim[3|l; (e) 
follows from the fact that X2 is a function of (14^2, 5f~^) 
(see Claim |4]); (/) follows from the fact that conditioning 
reduces entropy. Hence, we get 

i?i + i?2 < h{Yi\Si,X2) - h{Zi) + h{Y2) - h{Z2). 
Note that 



HY2) < log27re [1 + SNR2 + INR12 + 2|p| i/SNRa • INR12 

(74) 

From ( [72] i and ( [74| , we get the desired upper bound. 
Proof of (|26i): 



> Y hiYu\Wi,W2, Yl~\Y^~\Xu,X2^) 



N{2Ri +R2- ejv) < I{Wi;Yf) 
+ I{Wi;Yf\W2) + I{W2;Y2^) 

< [Mi^i^) - hiY.'^lW,)] + /(W^i; Fi^, S^\W2) 

+ [hiY2'')-h{Y2''\W2)] 

[/i(yi^) - hiY,^\W,)] + h{Yf, S^\W2) 

- 5^[/i(Zh) + h{Z2.)] + [/l(r2'^) - h{Yi^\W2)] 

[Myi^) - h{s^\w^)] + /i(y2'^) + /^(yi^|M/2, s^) 

- 5][/i(ZH) + ;i(Z2.)] 

= h{Yf) - ^[M^h) + h{Z2^)] + /i(Yi^|M^2,5f ) 

+ /(M/i;^2^)-M5i') + M>^2'^) 



21 



= ) - lJi{Zu) + h{Z2i)\ + h{Y^^\W2, s^) 
-I{S^-Yi^)-h{S^\Yi^) 



(d) 



h{Z^) + h(Yl'\W2,S^') + h{Yi'\S^) 



I [S^ ,Yf ,W2;W, 
-T + I (Yf-Wi\W2 
h(s^\Yr,W2,Y2'' 



T + I{Yf-Wi\W: 



' 2 

7N\cN 



-h[s^\Yf,W2,Y,^) 
+ I[S^;W,\W2,Y2'') 

+ l(^Z^;W,\W2,Y,^) 



h[^Znsr,W2,Y^' 

: T ~ h{Z^) +I (f2^; W^W2) + h{Z^) 




W,,W2.Yi']+I{Z'^-.S'^\W2.Yi^) 



r + I{Z^ ■ 5f \W2.Yi') + I {fi' ; , I W2 
= T'+ /(Zf ; 5f , Yi'\W2) + I {fi"; W,\W2, 

^^r + l(Yf;Wi\W2,Z^) 
+ I{Z^;Y,''\W,,W2,Z^) 

h{Y,^) h(Z^) + h{Yf\S^) - h{Z^) 
+ h{Y,''\W2.S^,X^)^h{Z^) 
+ l{Yi'-W^\W2,Z^) 
+ I{Y,'';Z^\W^,W2,Z^) 



< NCfbi 



NCi 



FB2 



J2[KYl^\Su,X2^)-h{Zu)] 
J2[HY2^\S2^) - h{Z2.0], 



KZu)] 



(75) 



where (a) follows from the non-negativity of mutual infor- 
mation; (6) follows from h{Y/^ , Sf' \Wi,W2) = 'EHZu) + 
HZ2i)] (by Claim |6]); (c) follows from Claim |3j (d) follows 
from the non-negativity of mutual information and the fact that 
conditioning reduces entropy; (e) is true since Z^ , W\, and 
W2 are mutually independent; (/) follows from the fact that 
is a function of (W^i, Yj^, Z^); (g) can be obtained by 
taking similar steps as in ([28|; {K) follows from Claim g {i) 
follows from the fact that H{Yj^) < NCpBk and conditioning 
reduces entropy. 
Also note that 



Mn|^2,^i)<log2^e 1 



1 + (1- |p|2)INRi2 



(76) 



Appendix D 
Gap Analysis of Theorem |5] 

We show that our proposed achievability strategy in Sec- 
tion IVI-B2I results in a sum-rate to within at most 14.8 
bits/sec/Hz of the outerbounds in Corollary [T] It is sufficient 
to prove this for the extreme case of feedback capacity 
assignment, i.e., where Cfbi ~ Cfb and Cfb2 = (or 
symmetrically CpBi — and Cfb2 — C'fb)- The reason is 
as follows. Consider our achievability strategy for the general 
feedback strategy described previously, and let CpBi — ACfb 
and Cfb2 = (1 - A)Cfb, such that < A < 1. Under these 
assumptions, for any value of A, the outerbounds on sum- 
rate in ( |33a| i,( |33b] i, and ( |33c| i would be the same, call the 
minimum of them C*. Assuming that we can achieve to within 
14.8 bits/sec/Hz of this outer-bound in the extreme cases, then, 
with the described achievability scheme for general feedback 
assignment, we can achieve 

i?suM = Ai?^-=° + (1 - A) (77) 
> A (C* - 14.8) + (1 - A) (C* - 14.8) = (C* - 14.8) . 

We now prove our claim for the extreme cases. By sym- 
metry, we only need to analyze the gap in one case, say 
Cfbi = C'fb and Cfb2 = 0. We assume that INR > 1, since 
for the case when INR < 1, by ignoring the feedback and 
treating interference as noise, we can achieve a sum-rate of 

21ogri + ^), (78) 



i + iNRy 

which is at most within 2.6 bits of outerbound ( |33b| i in 
Corollary [T] 

log f 1 + ^Tir, ) + log fl + SNR + INR + 2\/SNR- INR 



-21og( 1 

(INR<1 



1 + iNRy 

SNR 



1 + INR, 

log (1 + SNR + INR + 2VSm ■ INr) 



(INR<1) 

< log(2 + 3SNR)-log(l + SNR) + l 

, /2 + 3SNR\ ^ 
= log ( , ^..^ I + 1 



1 + SNR 

< log (3) + 1 < 2.6 



(79) 



We consider five different subcases. 
Case (a) log (INR) < i log (SNR): 

For this case, we pick the following set of power level^ 



min{2C^'=B INR - 1})" 



p(i) - (A 

^1 ^ ViNR SNR 

Pi = skn min{2C^FB INR - 1} 
Pf^ = ^min{2C^-,INR-l} 



(1) 

(2) 



INR 

1 
INR 

1 

2INR 



(80) 



min{2'^'=B INR - 1} 



Therefore, we get the desired bound. 



^Remember that starting the beginning of Section |VI-B2| we have assumed 
that INR > 1. Hence, we are not encountering division by zero in power 
assignments of jSOj. 
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Note that the power levels are non-negative, and at trans- 
mitter 1, we have 



+ S^niin{2^-,INR-1} 

(a) 1 1 



1 

INR 



min{2'^'=«, INR - 1} 



< 



...r. ^..r. min{2^F«,INR- 1} 
INR SNR ^ ' ' 

^ min{2^-, INR - 1} + |^ min{2^-, INR - 1} 

irk +11^ "^^^{2'^^' 
INR- 1 



1 



< 1, 



INR INR 

where (a) follows from the fact that 



(81) 



1 



min{2'^'=B^ _ 1} < 



SNR 

At transmitter 2 



INR-l (INR^<SNR) 1 



SNR 



< 



INR' 



(82) 



P2=P2 



(1) 

2 
1 



Pr 



(2) 



< 



, — min{2'^'=^INR- 1} 
INR 2INR ^ ' ' 

1 INR-1 

< 1. 



(83) 



INR INR 

By plugging the given values of power levels into our 



achievable sum-rate i?su'M defined in (|48|), we get 



r: 



(a) 
SUM 



log 1 



SNRP| 



(1) 



1 + INRP|^^^^ +SNRPf \ 



+ log 
+ log 
= log 
+ log 
+ log 



/ SNRP{ 



(2)^ 



INRP 



(2) 



1 + INRP 



(1) 
3(2) 



, r SNRP2 

log 1 + ^ 



(1:2)- 



(1)~ 



2-|-INRP2^"^ +SNRP| 
^ 2 + INRPf' +SNRPi^^^ 



/ SNRPf 



, (1 SNR\ 
1°^I^+2INr) 



INRP 



(2) 



1 + INRP 



(1) 



(a) 

> log 



2 + INRP2'^' +SNRP|'^^^ 1 + SNRPi^ 



(1:2) 



3(2) 



2 1 + SNRP| 



(2) 



, , SNR\ , / INRP; 



(2) 



1 + INRPi^^ 



log ( 2 + INRP2^^' + SNRPi^^^^' 



log 1 



SNR\ 
2INR ) 



+ log 



min{2'^'=B^ INR - 1} 



> log (2 + INRP2^^^ + SNRPi^^^^^) + log ^1 
+ min{CFB,log(INR- 1)+} - 6 



> log [2 + \mP^^'^ + SNRP|'^"^ j + log ( 1 
+ min{CFB, log (1 + INR)} - log (3) - 6, 



(1:2) 



SNR' 

Tnr . 



SNR 

Tnr 



(84) 



where (a) follows from the assumption SNR > INR > 1, and 
the last inequality holds since 

log (INR - 1)+ > log (1 + INR) - 3 V INR > 1. (85) 



• If Cfb < log (1 + INR): Considering the outerbound in 
i33ci, in this case we can write 



i?i+i?2<21og(l + iNR+^^) 
<21og( 1 + INR+^j +Cfb 

^, ,^ inrVsnr\ ^ 

21og 1 + ) + Cfb 



FB 



INR J 

(lNR^<SNR) / 2SNR\ 

<21og( 1 + ^") +Cfb + 2. 



(86) 



The gap between the achievable sum-rate of (84i and the 



outerbound in ( 86 1, is upper bounded by 



8 + log(3) + 21og (^1 + ^^ +Cfb 
- log (2 + INRP2^^' + SNRPi^^^^' 

< 8 + log (3) + log (1 + ^ ) - log ( 2 



INR / 



SNR\ 

Inr; 



< 8 + log (3) , 



• If Cfb > log (1 + INR): Considering the outerbound in 
P3b| l, in this case we can write 



SNR 



+ log (1 + SNR + INR + 2VSNR- INR 

1 f. SNR 

< log 1 + 



INR 



log (1 + SNR + INR + 2VSNR • INr) . (87) 



The gap between the achievable sum-rate of (84i and the 
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outerbound in ( [87| , is upper bounded by 

6 + log (3)+ log (^1 + ^^ 
+ log (l + SNR + INR + 2VSm ■ INR 

- log (1 + INR) 

< 6 + log (3) -log (2+^) 



log 1 



SNR + 2VSNR- INR' 
INR 



<6 + log(3)-log (2+^^ 

< 6 + 21og (3). 

Hence, we conclude that the gap between the inner-bound 
and the outer-bound is at most 8 + log (3) < 9.6 bits/sec/Hz. 
Case (b) i log (SNR) < log (INR) < | log (SNR): 

For this case, we pick the following set of power level^ 



p(i) _ 
^1 — 



(2) 
L 

(3) 



_1 ]_ 

INR SNR 



SNR 



p(4) _ 

p(l) _ 

(2) ^ 



nin{2*^'='' 
iin{2'^™ 

l_p(i:3)y 



INR 



min{2^-,fM!_i} 

SNR" 
' INR-' 
SNR" 
' INR^' 



-1} 
1} 



(88) 



1 

INR 

1 



SNR" 



2INR iiiin{2'^'''', "n^RB- 



1} 



All the power levels are non-negative. Also, we have 



(1) 



-P. 
1 



(2) 



VINR SNR 



p(3) 

1 , r SNR2 

min{2'^™, =- - 1} 



INR-' 



SNR 

(a) 1 



1 . ^„ SNR2 
mmji 



inr3 



SNR 

1 



1 • r„r„ SNR2 
^ INR^ 

3 1} + 



INR SNR 

1 , ^ SNR2 

min{2'^F^ 

INR 



1 

INR ' 

1} 

INR 



i{2^ 



SNR^ 
INR3 



-1} 



1 . snr2 

min{2<^'=^ 



INR-' 



1 



INR INR 



i{2 



Cfb 



SNR^ 
INR3 



-1} 



SNR2 (ySNR<INR) ^SNR 

< X- < < 1, 

- INR4 - INR - ' 

where (a) follows from the fact that 



(89) 



1 

SNR 

'^INR > 1. 



1 



1 



i{2^-,^-l}< ^= < — . (90) 
INR=^ ^ - ySNR "INR 



Since F| 



(4) 



(1:3) 



Similarly, we can show that 



, we conclude that Pi < 1. 
< 1. 



By plugging the given values of power levels into our 



achievable sum-rate R^um defined in (|57b, we have 



, ( 1 + INRP,^^^+SNRP|^^') ' 
^SUM = log 



(1) 



log 



V 1 + INRB_ 

2INR + SNR + INR^-2INR\ 



2INR + SNR 



1 SNR\ 



/2INR + SNR + INR2 -3/2INR\ 
~^ °^ 1^ 2INR + SNR ) 



min{CFB,log 



/SNR2 
V INR^ 



-1 }-3 



> log 



2 + SNRPi^ 



(1:2)- 



, / SNR\ /INR2\ 
+ l°H' + ^J^'^°H3SNRj 

. ,^ , /snr2 



1 3 1 }-3 
V INR^ ' 



> 2 log 1 



SNR 



2INR / 



2 log 



INR2 \ 
3SNR j 



min{CFB,log 



/SNR2 
V INR^ 



-1 }-3 



^ 21og f^^^V21og(lNR') -21og(3SNR) 



2INR J 

/SNR^ \ + 
+ min{CFB,log(^^^-lj }-3 

= 21og(l + SNR)-21og(INR) 
+ 41og(INR)-21og(3SNR) 



/SNR2 
V INR^ 



min{CFB,log( ^^-1) }-3 



> 21og(l + INR) 

+ min{CFB,logf^-l) }-5-21og(3). (91) 



1} We first simplify the outerbounds in (33bi and (33ci 



Considering the outerbound in ( 33c 1, for this case we can write 



i?i + i?2 < 21og (^1 + INR + ^^^^ + Cfb 
<21og (^l + INR+^^ +Cfb 

(SNR<INR") 

< 21og(l + INR + INR) + CFB 
= 21og(l + 2INR) + CFB 
<21og(l + INR) + CFB + 2, 



(92) 
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and for the outerbound in (|33bj), we have 

, , SNR 

i?i + i?2 < log 1 



1 + INR 



+ log (l + SNR + INR + 2\/SNR - INR 

(INR<SNR) 

< log (1 + INR + SNR)- log (1 + INR) 
+ log(l + 4SNR) 

(INR<SNR) 

< 21og(l + SNR)-log(l + INR) + 3. 
We consider two possible scenarios based on Cfb, 



(93) 



- 1 



(l)CpB<l0g(f|! 

With this assumption, we have 

i?^UM > 2 log (1 + I N R) + Cfb - 5 - 2 log (3) , (94) 
note that, in this case 



Cfb < log 



SNR^ 
INR^ 



- 1 



< log 1 



SNR' 
INR^ 



(%/SNR<INR) 

< log (1 + INR), 



therefore, from ( |92] l we get 

Ri+R2< 21og(l 



INR) + Cfb + 2. 



(95) 



(96) 



Hence, the gap between the achievable sum-rate of (94i 



and the outer-bound in (96 1 is at most 7 + 2 log (3) < 10.2 
bits/sec/Hz. 



SNRl 
INR3 



- 1 



(2) Cfb > log 
We have 

4*UM>21og(l + INR) + log(l 



SNR^ 



3 log (3) 



INR 

>21og(l + INR) + 21og(SNR) 

-31og(INR)-5-31og(3) (97) 

> 2 log (1 + INR) + 2 log (1 + SNR) 

-31og(l + INR)-7-log(3) 

= 21og (1 + SNR) - log (1 + INR) - 7 - Slog (3) . 

Hence, the gap between the achievable sum-rate of ([97|) 



and the outer-bound in (93i is at most 10 + 3 log (3) < 14.8 
bits/sec/Hz. As a result, the gap between the inner-bound and 
the minimum of the outer-bounds in ([33b| and (|33c| is at most 
14.8 bits/sec/Hz. 

Case (c) 2 log (SNR) < log (INR): 
• If SNR < 1, pick 

1 



P. 



(2) 



(3) 



INR 



min{2'^FB iNR}^ 



and set all other power levels equal to zero. By plugging 
the given values of power levels into our achievable sum-rate 



(c) 

^SUM defined in (61 



R. 



SUM 



we get 

, , min{2<^'=B INR} 
log 



= min{CFB,log(INR)}-l 

> min{CFB,log(l + INR)} - 2. 



(98) 



Consider the outerbounds in ([33a| and P3b[ ), under the 
assumptions of case (c) and SNR < 1, we have 

i?i + i?2 < min{21og (1 + SNR) + Cfb, 

1 A SNR 

log IH 

^\ 1 + INR, 

+ log (l + SNR + INR + 2\/SNR • INr) } 

< min{21og(2) +CFB,log (2) + log (2 + 3INR)} 

< min{2 + C7fb, 1 + log (3) + log (1 + INR)} 
<min{CFB,log(l + INR)} + 2.6. (99) 

Therefore, with the given choice of power levels the achiev- 
able sum-rate of ( [98] ) is within 2.6 bits/sec/Hz of the minimum 
of the outerbounds in ( |33a| l and P3b| l. 
• If SNR > 1, pick 

Pick the following set of power levels: 

' P^'^ = 



) = 



3(3) 



S^^min{2^-,JM,} 



INR 



1-p; 



(3) 



(100) 



Po^^ Tids mm 



1 

INR 

1 



p?) = l-p(^) 



INR 

SNR^ 



} 



2 ^ ^ ^ ^ 2 

It is straight forward to check that the power levels are 
non-negative and they satisfy the power constraint at the 
transmitters. By plugging the given values o f po wer levels 



into our achievable sum-rate Rriir. defined in (61 



R. 



SUM 



log 1 



SNR(1 



SUM 
SNR' 



, we get 



log 1 



SNR(1 



SNR' 



log 



> 2 log (1 + SNR) + min{CFB, log 



= min{21og(l + SNR) + CFB 
2 log (1 + SNR) + log' "^'^ 



JNR 
SN 



IR^I^ 



' INR 
SNR2 



2 

}-3 



VsnrV 

> min{21og (1 + SNR) + Cfb, log (1 + INR)} - 4. (101) 

Consider the outerbounds in ([33a| and P3b[ ), under the 
assumptions of case (c), we have 

Pi +P2 < min{21og(l + SNR) + Cfb, 
. SNR 

^"H^TTTnr, 

+ log (1 + SNR + INR + 2ySNR • INr) } 

< min{21og (1 + SNR) + Cfb, 
log(2) + log(l + 4INR)} 

< min{21og(l + SNR) + CFB,3 + log(l + INR)} 

< min{21og(l + SNR) + CFB,log(l + INR)} + 3. (102) 

Therefore, with the given choice of power levels the achiev- 
able sum-rate of ( |6T] l is within 7 bits/sec/Hz of the minimum 
of the outerbounds in ( |33a| i and P3b| i. 
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Case (d) | log (SNR) < log (INR) < log (SNR): 

In this case feedback is not needed. The achievability 
scheme of |35| for Gaussian IC without feedback, results in a 
sum-rate to within 1 bit/sec/Hz of 



log (1 + SNR) + log 1 + 



SNR 



1 + INR^ 

For the outerbound in ( |33b| l, in this case we have 
SNR 



(103) 



Ri+R2< log 1 



1 + INR^ 

log (l + SNR + INR + 2VSNR - INr) 
^^'^ ^ +log(l + 4SNR) 



< log 1 

(104) 

Therefore, the achievable sum-rate of ll35l is within 3 
bits/sec/Hz of the outerbound in ( |33b| l. 
Case (e) log (SNR) < log (INR) < 2 log (SNR): 

In this case feedback is not needed. The achievability 
scheme of (35 \ for Gaussian IC without feedback, results in a 
sum-rate to within 1 bit/sec/Hz of 



log (1 + SNR + INR) . 
For the outerbound in (|33b|, in this case we have 

, f SNR 

Ri + i?2 < log 1 



(105) 



1 + INR 



+ log + SNR + INR + 2VSNR- INR 

(SNR<INR) 

< log(2) +log(l + 4INR) 
< log (1 + INR) + 3. 



(106) 



Therefore, the achievable sum-rate of 135] is within 4 
bits/sec/Hz of the outerbound in ( |33b| i. 
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